Nov 03 11:58:40 devstack cinder-volume[75498]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 11:58:40 devstack cinder-volume[75498]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 11:58:40 devstack cinder-volume[75498]: we strongly recommend against using it for new projects. Nov 03 11:58:40 devstack cinder-volume[75498]: If you are already using Eventlet, we recommend migrating to a different Nov 03 11:58:40 devstack cinder-volume[75498]: framework. For more detail see Nov 03 11:58:40 devstack cinder-volume[75498]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 11:58:40 devstack cinder-volume[75498]: import eventlet # noqa Nov 03 11:58:43 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 11:58:43 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 11:58:43 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 11:58:44 devstack cinder-volume[75498]: INFO dbcounter [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Registered counter for database cinder Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG oslo_db.sqlalchemy.engines [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG dbcounter [-] [75498] Writer thread running {{(pid=75498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 11:58:44 devstack cinder-volume[75498]: INFO cinder.rpc [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 11:58:44 devstack cinder-volume[75498]: INFO cinder.rpc [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG oslo_db.sqlalchemy.engines [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 11:58:44 devstack cinder-volume[75498]: INFO cinder.volume.manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Determined volume DB was empty at startup. Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG cinder.volume.manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75498) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 11:58:44 devstack cinder-volume[75498]: INFO cinder.volume.manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 11:58:44 devstack cinder-volume[75498]: WARNING stevedore.named [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 11:58:44 devstack cinder-volume[75498]: WARNING castellan.key_manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 11:58:44 devstack cinder-volume[75498]: WARNING cinder.keymgr.conf_key_mgr [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG cinder.volume.drivers.lvm [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75498) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 11:58:44 devstack cinder-volume[75498]: DEBUG oslo_concurrency.processutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_concurrency.processutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] CMD "cinder-rtstool verify" returned: 0 in 0.400s {{(pid=75498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_db.sqlalchemy.engines [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 11:58:45 devstack cinder-volume[75498]: INFO cinder.rpc [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 11:58:45 devstack cinder-volume[75498]: INFO cinder.rpc [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 11:58:45 devstack cinder-volume[75498]: WARNING stevedore.named [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 11:58:45 devstack cinder-volume[75498]: WARNING castellan.key_manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 11:58:45 devstack cinder-volume[75498]: INFO cinder.volume.manager [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_db.sqlalchemy.engines [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 11:58:45 devstack cinder-volume[75498]: INFO oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Starting 1 workers Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Started child 75646 {{(pid=75498) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Full set of CONF: {{(pid=75498) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] ******************************************************************************** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Configuration options gathered from: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] ================================================================================ {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] allow_availability_zone_fallback = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] allow_compression_on_image_upload = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] allowed_direct_url_schemes = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] api_rate_limit = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] auth_strategy = keystone {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] az_cache_duration = 3600 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75646]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_availability_zone = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_host = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_stats_polling_interval = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backup_api_class = cinder.backup.api.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backup_name_template = backup-%s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backup_use_same_host = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backup_use_temp_snapshot = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] chap_password = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] chap_username = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_internal_tenant_project_id = 230d1db5a5eb476396f5dbe0493ad097 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_internal_tenant_user_id = 34d3726fc2ae42a293c4dd74cebba8ea {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cloned_volume_same_az = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cluster = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] compression_format = gzip {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] compute_api_class = cinder.compute.nova.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] config_dir = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] config_source = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] control_exchange = openstack {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] debug = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] default_availability_zone = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] default_group_type = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] default_volume_type = lvmdriver-1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] disk_geometry = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_client_cert = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_client_cert_key = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_data_namespace = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_ssl_cert_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_ssl_cert_verify = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] driver_use_ssl = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] enable_force_upload = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] enable_new_services = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] enable_unsupported_driver = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] enabled_backends = ['lvmdriver-1'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] enforce_multipath_for_image_xfer = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] filter_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_api_insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_api_ssl_compression = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_ca_certificates_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_catalog_info = image:glance:publicURL {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_num_retries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance_request_timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] goodness_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] graceful_shutdown_timeout = 5 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] group_api_class = cinder.group.api.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] host = devstack {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_compress_on_upload = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_conversion_address_space_limit = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_conversion_cpu_limit = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_conversion_disable = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_introspection_address_space_limit = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_introspection_cpu_limit = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_upload_use_cinder_backend = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_upload_use_internal_tenant = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_volume_cache_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_volume_cache_max_count = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] image_volume_cache_max_size_gb = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] init_host_max_objects_retrieval = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] instance_format = [instance: %(uuid)s] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iscsi_target_flags = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iscsi_write_cache = on {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iser_helper = tgtadm {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iser_ip_address = 192.168.122.148 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iser_port = 3260 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_color = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_config_append = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_dir = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_options = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_rotate_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_rotate_interval_type = days {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] log_rotation_type = none {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] max_age = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] max_logfile_count = 30 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] max_logfile_size_mb = 200 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] max_over_subscription_ratio = 20.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] message_reap_interval = 86400 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] message_ttl = 2592000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] migration_create_volume_timeout_secs = 300 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] monkey_patch = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] monkey_patch_modules = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] my_ip = 192.168.122.148 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] no_snapshot_gb_quota = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] num_iser_scan_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] num_shell_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] num_volume_device_scan_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] nvmeof_conn_info_version = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] nvmet_ns_id = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] nvmet_port_id = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_max_limit = 1000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_ext_list = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_listen = 0.0.0.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_listen_port = 8776 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_use_ssl = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] osapi_volume_workers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] per_volume_size_limit = -1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] periodic_fuzzy_delay = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] periodic_interval = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] project_id_regex = [0-9a-f\-]+ {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] public_endpoint = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] publish_errors = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_backup_gigabytes = 1000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_backups = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_gigabytes = 1000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_groups = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_snapshots = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] quota_volumes = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] rate_limit_burst = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] rate_limit_except_level = CRITICAL {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] rate_limit_interval = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] reinit_driver_count = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] replication_device = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] report_discard_supported = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] report_interval = 120 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] reservation_clean_interval = 86400 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] reservation_expire = 86400 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] reserved_image_namespaces = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] reserved_percentage = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] rpc_response_timeout = 120 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] run_external_periodic_tasks = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] scst_target_driver = iscsi {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] scst_target_iqn_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_down_time = 720 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] shell_completion = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] snapshot_name_template = snapshot-%s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] snapshot_same_host = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] split_loggers = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] state_path = /opt/stack/data/cinder {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] storage_availability_zone = nova {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] storage_protocol = iSCSI {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] syslog_log_facility = LOG_USER {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_helper = lioadm {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_ip_address = 192.168.122.148 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_port = 3260 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_protocol = iscsi {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] target_secondary_ip_addresses = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] trace_flags = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] transfer_api_class = cinder.transfer.api.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] transport_url = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] until_refresh = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_chap_auth = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_default_quota_class = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_journal = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_json = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_multipath_for_image_xfer = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_stderr = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] use_syslog = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] verify_glance_signatures = enabled {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_api_class = cinder.volume.api.API {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_backend_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_clear = zero {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_clear_ionice = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_clear_size = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_copy_bps_limit = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_dd_blocksize = 1M {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_name_template = volume-%s {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_service_inithost_offload = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volume_usage_audit_period = month {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] zoning_mode = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_concurrency.disable_process_locking = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.auth_section = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.auth_type = password {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.auth_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.cache = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.delay_auth_decision = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.http_connect_timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.include_service_catalog = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.interface = public {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_password = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcache_username = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.region_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.service_token_roles_required = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.service_type = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.token_cache_time = 300 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.backend = dogpile.cache.null {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.backend_argument = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.backend_expiration_time = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.config_prefix = cache.oslo {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.debug_cache_backend = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.enable_retry_client = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.enable_socket_keepalive = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.expiration_time = 600 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.hashclient_retry_attempts = 2 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_dead_retry = 300 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_pool_maxsize = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_sasl_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.password = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.proxies = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.redis_db = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.redis_sentinel_service_name = mymaster {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.redis_server = localhost:6379 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.retry_attempts = 2 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.retry_delay = 0.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.socket_keepalive_count = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.socket_keepalive_idle = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.socket_keepalive_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.socket_timeout = 1.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.tls_allowed_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.tls_cafile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.tls_certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.tls_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.tls_keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cache.username = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] coordination.backend_url = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.asyncio_connection = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.asyncio_slave_connection = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.backend = sqlalchemy {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.connection = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.connection_debug = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.connection_parameters = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.connection_recycle_time = 3600 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.connection_trace = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.db_inc_retry_interval = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.db_max_retries = 20 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.db_max_retry_interval = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.db_retry_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.max_overflow = 50 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.max_pool_size = 5 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.max_retries = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.mysql_wsrep_sync_wait = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.pool_timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.retry_interval = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.slave_connection = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.sqlite_synchronous = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.synchronous_reader = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] database.use_db_reconnect = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_tracing.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.connection_string = messaging:// {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.es_doc_type = notification {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.es_scroll_size = 10000 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.es_scroll_time = 2m {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.filter_error_trace = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.hmac_keys = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.sentinel_service_name = mymaster {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.socket_timeout = 0.1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.trace_requests = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler.trace_sqlalchemy = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler_jaeger.process_tags = {} {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler_jaeger.service_name_prefix = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] profiler_otlp.service_name_prefix = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.enforce_new_defaults = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.policy_default_rule = default {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.policy_file = policy.yaml {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_policy.remote_timeout = 60.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.group = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.helper_command = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] privsep_osbrick.user = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.group = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.helper_command = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] cinder_sys_admin.user = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.auth_section = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.auth_type = password {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.cafile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.collect_timing = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.send_service_user_token = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.split_loggers = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.tls_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] service_user.tls_min_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.auth_section = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.auth_type = password {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.collect_timing = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.region_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.split_loggers = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.tls_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] glance.tls_min_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.backend_availability_zone = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.chap_password = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.chap_username = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.disk_geometry = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_client_cert = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_client_cert_key = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_data_namespace = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.driver_use_ssl = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.enable_unsupported_driver = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.extra_capabilities = {} {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.filter_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.goodness_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack sudo[75650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iscsi_target_flags = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iscsi_write_cache = on {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iser_helper = tgtadm {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iser_port = 3260 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack sudo[75650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.lvm_mirrors = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.lvm_share_target = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.lvm_type = auto {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.num_shell_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.nvmet_port_id = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.replication_device = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.report_discard_supported = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.reserved_percentage = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.scst_target_driver = iscsi {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.scst_target_iqn_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.storage_protocol = iSCSI {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_helper = tgtadm {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_port = 3260 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_protocol = iscsi {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.trace_flags = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.unique_fqdn_network = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.use_chap_auth = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_backend_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_clear = zero {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_clear_ionice = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_clear_size = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volume_group = cinder-volumes {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_reports.file_event_handler = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_reports.log_dir = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.backend_availability_zone = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.backend_host = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.chap_password = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.chap_username = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.chiscsi_conf = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.disk_geometry = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_client_cert = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_data_namespace = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.driver_use_ssl = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.extra_capabilities = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.filter_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.goodness_function = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iser_helper = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iser_ip_address = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iser_port = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.iser_target_prefix = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.lvm_conf_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.lvm_mirrors = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.lvm_share_target = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.lvm_type = auto {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.num_shell_tries = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.nvmet_port_id = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.replication_device = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.report_discard_supported = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.reserved_percentage = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.scst_target_driver = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.storage_protocol = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_helper = lioadm {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_ip_address = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_port = 3260 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_protocol = iscsi {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.trace_flags = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.use_chap_auth = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_clear = zero {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_clear_size = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] lvmdriver-1.volumes_dir = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.ssl_version = {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_notifications.driver = [] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_notifications.retry = -1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] key_manager.fixed_key = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.barbican_api_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.barbican_endpoint = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.barbican_endpoint_type = public {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.barbican_region_name = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.cafile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.collect_timing = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.number_of_retries = 60 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.retry_delay = 1 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.send_service_user_token = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.split_loggers = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.tls_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.tls_min_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.verify_ssl = True {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican.verify_ssl_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.auth_section = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.auth_type = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.cafile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.certfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.collect_timing = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.insecure = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.keyfile = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.split_loggers = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.timeout = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.tls_ciphers = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] barbican_service_user.tls_min_version = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.approle_role_id = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.approle_secret_id = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.auth_method = approle {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.auth_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.kv_mountpoint = secret {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.kv_path = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.kv_version = 2 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.namespace = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.root_token_id = **** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.ssl_ca_crt_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.timeout = 60.0 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.token_file = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.token_role = None {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.use_ssl = False {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 11:58:45 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] ******************************************************************************** {{(pid=75498) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 11:58:46 devstack sudo[75650]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:46 devstack sudo[75789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:46 devstack sudo[75789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:46 devstack sudo[75789]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 11:58:46 devstack cinder-volume[75646]: INFO cinder.brick.local_dev.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:46 devstack sudo[75883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:46 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:46 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG cinder.brick.local_dev.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75646) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 11:58:46 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:46 devstack sudo[75969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:46 devstack sudo[75969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:47 devstack sudo[75969]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:47 devstack sudo[76168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:47 devstack sudo[76168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:47 devstack sudo[76168]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.338s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:47 devstack sudo[76260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 11:58:47 devstack sudo[76260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:47 devstack sudo[76260]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:47 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:47 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:47 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:48 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:48 devstack sudo[76347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:48 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:48 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:48 devstack sudo[76354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:48 devstack sudo[76354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:48 devstack sudo[76354]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:48 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:48 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:48 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:49 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:49 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:49 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: INFO cinder.volume.drivers.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack sudo[76453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:49 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:49 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:49 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:49 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:49 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:49 devstack sudo[76465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:49 devstack sudo[76465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:50 devstack sudo[76465]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:50 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:50 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:50 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:50 devstack sudo[76471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:50 devstack sudo[76471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:50 devstack sudo[76471]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:50 devstack cinder-volume[75646]: INFO cinder.volume.driver [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG cinder.volume.driver [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75646) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_db.sqlalchemy.engines [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writer thread running {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG cinder.db.api [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Building query based on filter {{(pid=75646) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG cinder.image.image_utils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75646) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 11:58:50 devstack cinder-volume[75646]: INFO cinder.keymgr.migration [None req-146689ad-9195-464a-95d3-31415c64f885 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 11:58:50 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:50 devstack sudo[76474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:50 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:51 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:51 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:51 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:51 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:51 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:51 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:51 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:51 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:51 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:51 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG cinder.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Notifying Schedulers of capabilities ... {{(pid=75646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 11:58:51 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Driver initialization completed successfully. Nov 03 11:58:51 devstack cinder-volume[75646]: INFO cinder.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Initiating service 2 cleanup Nov 03 11:58:51 devstack cinder-volume[75646]: INFO cinder.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Service 2 cleanup completed. Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG cinder.service [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Creating RPC server for service cinder-volume {{(pid=75646) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 11:58:51 devstack cinder-volume[75646]: DEBUG cinder.service [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75646) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 11:58:52 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:52 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 11:58:52 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:52 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:52 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:52 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:52 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:52 devstack sudo[76498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 11:58:52 devstack sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:52 devstack sudo[76498]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:52 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 11:58:52 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 11:58:52 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 11:58:53 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Nov 03 11:58:53 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 11:58:53 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-5139b720-b135-4656-8e39-87b9750eb8b2 None None] Driver post RPC initialization completed successfully. Nov 03 11:58:55 devstack cinder-volume[75498]: DEBUG dbcounter [-] [75498] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 11:59:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 11:59:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 11:59:20 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager._thread_info {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 11:59:20 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread count: 6 {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 11:59:20 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread info: [<_MainThread(MainThread, started 134065487057024)>, , , , , ] {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:00:20 devstack sudo[80081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:00:20 devstack sudo[80081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:00:20 devstack sudo[80081]: pam_unix(sudo:session): session closed for user root Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:00:20 devstack sudo[80220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:00:20 devstack sudo[80220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:00:20 devstack sudo[80220]: pam_unix(sudo:session): session closed for user root Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:00:20 devstack sudo[80357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:00:20 devstack sudo[80357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:00:20 devstack sudo[80357]: pam_unix(sudo:session): session closed for user root Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:00:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:00:20 devstack sudo[80508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:00:20 devstack sudo[80508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:00:21 devstack sudo[80508]: pam_unix(sudo:session): session closed for user root Nov 03 12:00:21 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:00:21 devstack cinder-volume[75646]: DEBUG cinder.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Notifying Schedulers of capabilities ... {{(pid=75646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:00:21 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager._thread_info {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:00:21 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread count: 6 {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:00:21 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread info: [<_MainThread(MainThread, started 134065487057024)>, , , , , ] {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:01:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:SELECT=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:01:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:UPDATE=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:01:20 devstack sudo[82915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:01:20 devstack sudo[82915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:01:20 devstack sudo[82915]: pam_unix(sudo:session): session closed for user root Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:01:20 devstack sudo[82924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:01:20 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:01:20 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:01:20 devstack sudo[82931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:01:20 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:01:20 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:01:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:01:20 devstack sudo[82955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:01:20 devstack sudo[82955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:01:21 devstack sudo[82955]: pam_unix(sudo:session): session closed for user root Nov 03 12:01:21 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:01:21 devstack cinder-volume[75646]: DEBUG cinder.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Notifying Schedulers of capabilities ... {{(pid=75646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:01:21 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager._thread_info {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:01:21 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread count: 6 {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:01:21 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] thread info: [<_MainThread(MainThread, started 134065487057024)>, , , , , ] {{(pid=75646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_service.periodic_task [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Updating volume stats {{(pid=75646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:02:20 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:02:20 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:02:20 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:02:20 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:02:20 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:02:20 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:02:20 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:02:20 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:02:20 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:02:20 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:02:20 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:02:20 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:02:21 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Nov 03 12:02:21 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:02:21 devstack cinder-volume[75646]: DEBUG cinder.manager [None req-0f4b68d6-2d73-4e17-8432-38fa74077ff4 None None] Notifying Schedulers of capabilities ... {{(pid=75646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:03:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:SELECT=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:03:03 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:UPDATE=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:03:10 devstack cinder-volume[75498]: INFO oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Caught SIGTERM, stopping children Nov 03 12:03:10 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Acquiring lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:10 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Acquired lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:10 devstack cinder-volume[75498]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Releasing lock "singleton_lock" {{(pid=75498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:10 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Stop services. {{(pid=75498) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 12:03:10 devstack cinder-volume[75498]: DEBUG oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Killing children. {{(pid=75498) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 12:03:10 devstack cinder-volume[75498]: INFO oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Waiting on 1 children to exit Nov 03 12:03:12 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Acquiring lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:12 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Acquired lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:12 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Releasing lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:12 devstack cinder-volume[75646]: WARNING amqp [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:03:12 devstack cinder-volume[75646]: WARNING amqp [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:03:12 devstack cinder-volume[75498]: INFO oslo_service.backend._eventlet.service [None req-764edee2-44d1-437e-8e98-a1a6247030ac None None] Child 75646 exited with status 0 Nov 03 12:03:12 devstack cinder-volume[85677]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 12:03:12 devstack cinder-volume[85677]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:03:12 devstack cinder-volume[85677]: we strongly recommend against using it for new projects. Nov 03 12:03:12 devstack cinder-volume[85677]: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:03:12 devstack cinder-volume[85677]: framework. For more detail see Nov 03 12:03:12 devstack cinder-volume[85677]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:03:12 devstack cinder-volume[85677]: import eventlet # noqa Nov 03 12:03:14 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:14 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:14 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:15 devstack cinder-volume[85677]: INFO dbcounter [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Registered counter for database cinder Nov 03 12:03:15 devstack cinder-volume[85677]: DEBUG oslo_db.sqlalchemy.engines [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85677) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:15 devstack cinder-volume[85677]: DEBUG dbcounter [-] [85677] Writer thread running {{(pid=85677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:03:15 devstack cinder-volume[85677]: INFO cinder.rpc [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 12:03:15 devstack cinder-volume[85677]: INFO cinder.rpc [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 12:03:15 devstack cinder-volume[85677]: DEBUG oslo_db.sqlalchemy.engines [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85677) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:15 devstack cinder-volume[85677]: INFO cinder.volume.manager [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Determined volume DB was empty at startup. Nov 03 12:03:15 devstack cinder-volume[85677]: DEBUG cinder.volume.manager [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85677) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 12:03:15 devstack cinder-volume[85677]: INFO cinder.volume.manager [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 12:03:15 devstack cinder-volume[85677]: WARNING stevedore.named [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:03:15 devstack cinder-volume[85677]: WARNING castellan.key_manager [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:03:15 devstack cinder-volume[85677]: WARNING cinder.keymgr.conf_key_mgr [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:03:15 devstack cinder-volume[85677]: INFO cinder.volume.manager [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 12:03:15 devstack cinder-volume[85677]: DEBUG oslo_db.sqlalchemy.engines [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85677) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:16 devstack cinder-volume[85677]: INFO oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Starting 1 workers Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Started child 85893 {{(pid=85677) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Full set of CONF: {{(pid=85677) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] ******************************************************************************** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Configuration options gathered from: {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] ================================================================================ {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] allow_availability_zone_fallback = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] allow_compression_on_image_upload = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] allowed_direct_url_schemes = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] api_rate_limit = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] auth_strategy = keystone {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_availability_zone = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_host = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_stats_polling_interval = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85893]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backup_api_class = cinder.backup.api.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backup_name_template = backup-%s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backup_use_same_host = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backup_use_temp_snapshot = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] chap_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] chap_username = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_internal_tenant_project_id = 230d1db5a5eb476396f5dbe0493ad097 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_internal_tenant_user_id = 34d3726fc2ae42a293c4dd74cebba8ea {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cluster = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] compression_format = gzip {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] compute_api_class = cinder.compute.nova.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] config_dir = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] config_source = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] control_exchange = openstack {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] debug = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] default_availability_zone = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] default_group_type = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] default_volume_type = QuobyteHD {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] disk_geometry = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_client_cert = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_client_cert_key = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_data_namespace = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_ssl_cert_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_ssl_cert_verify = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] driver_use_ssl = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] enable_new_services = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] enable_unsupported_driver = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] enabled_backends = ['QuobyteHD'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] enforce_multipath_for_image_xfer = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] filter_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_api_insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_api_ssl_compression = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_ca_certificates_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_catalog_info = image:glance:publicURL {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_num_retries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance_request_timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] goodness_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] graceful_shutdown_timeout = 5 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] group_api_class = cinder.group.api.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] host = devstack {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_compress_on_upload = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_conversion_address_space_limit = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_conversion_cpu_limit = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_conversion_disable = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_introspection_address_space_limit = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_introspection_cpu_limit = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_upload_use_cinder_backend = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_upload_use_internal_tenant = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_volume_cache_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_volume_cache_max_count = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] image_volume_cache_max_size_gb = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] init_host_max_objects_retrieval = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] instance_format = [instance: %(uuid)s] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iscsi_target_flags = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iscsi_write_cache = on {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iser_helper = tgtadm {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iser_ip_address = 192.168.122.148 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iser_port = 3260 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_color = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_config_append = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_dir = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_options = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_rotate_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_rotate_interval_type = days {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] log_rotation_type = none {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] max_age = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] max_logfile_count = 30 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] max_logfile_size_mb = 200 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] max_over_subscription_ratio = 20.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] message_reap_interval = 86400 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] message_ttl = 2592000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] migration_create_volume_timeout_secs = 300 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] monkey_patch = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] monkey_patch_modules = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] my_ip = 192.168.122.148 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] no_snapshot_gb_quota = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] num_iser_scan_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] num_shell_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] num_volume_device_scan_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] nvmeof_conn_info_version = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] nvmet_ns_id = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] nvmet_port_id = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_max_limit = 1000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_ext_list = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_listen = 0.0.0.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_listen_port = 8776 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_use_ssl = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] osapi_volume_workers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] per_volume_size_limit = -1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] periodic_fuzzy_delay = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] periodic_interval = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] project_id_regex = [0-9a-f\-]+ {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] public_endpoint = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] publish_errors = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_backup_gigabytes = 1000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_backups = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_gigabytes = 1000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_groups = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_snapshots = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] quota_volumes = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] rate_limit_burst = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] rate_limit_except_level = CRITICAL {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] rate_limit_interval = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.remotefs [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85893) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] reinit_driver_count = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] replication_device = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] report_discard_supported = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] report_interval = 120 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] reservation_clean_interval = 86400 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] reservation_expire = 86400 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] reserved_image_namespaces = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] reserved_percentage = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] rpc_response_timeout = 120 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] run_external_periodic_tasks = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] scst_target_driver = iscsi {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] scst_target_iqn_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_down_time = 720 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] shell_completion = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] snapshot_name_template = snapshot-%s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] split_loggers = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] state_path = /opt/stack/data/cinder {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] storage_availability_zone = nova {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] storage_protocol = iSCSI {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] syslog_log_facility = LOG_USER {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_helper = lioadm {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_ip_address = 192.168.122.148 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_port = 3260 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_protocol = iscsi {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] target_secondary_ip_addresses = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] trace_flags = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] transfer_api_class = cinder.transfer.api.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] transport_url = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] until_refresh = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_chap_auth = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_default_quota_class = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_journal = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_json = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_multipath_for_image_xfer = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_stderr = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] use_syslog = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] verify_glance_signatures = enabled {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_api_class = cinder.volume.api.API {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_backend_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_clear = zero {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_clear_ionice = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_clear_size = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_copy_bps_limit = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_dd_blocksize = 1M {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_name_template = volume-%s {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_service_inithost_offload = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volume_usage_audit_period = month {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] zoning_mode = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_concurrency.disable_process_locking = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.auth_section = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.auth_type = password {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.auth_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.cache = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.delay_auth_decision = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.http_connect_timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.include_service_catalog = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.interface = public {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcache_username = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.region_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.service_token_roles_required = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.service_type = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.token_cache_time = 300 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.backend = dogpile.cache.null {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.backend_argument = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.backend_expiration_time = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.config_prefix = cache.oslo {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.debug_cache_backend = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.enable_retry_client = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.enable_socket_keepalive = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.expiration_time = 600 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.hashclient_retry_attempts = 2 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_dead_retry = 300 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_pool_maxsize = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_sasl_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.proxies = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.redis_db = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.redis_sentinel_service_name = mymaster {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.redis_server = localhost:6379 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.retry_attempts = 2 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.retry_delay = 0.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.socket_keepalive_count = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.socket_keepalive_idle = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.socket_keepalive_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.socket_timeout = 1.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.tls_allowed_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.tls_cafile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.tls_certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.tls_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.tls_keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cache.username = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] coordination.backend_url = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.asyncio_connection = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.asyncio_slave_connection = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.backend = sqlalchemy {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.connection = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.connection_debug = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.connection_parameters = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.connection_recycle_time = 3600 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.connection_trace = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.db_inc_retry_interval = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.db_max_retries = 20 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.db_max_retry_interval = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.db_retry_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.max_overflow = 50 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.max_pool_size = 5 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.max_retries = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.mysql_wsrep_sync_wait = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.pool_timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.retry_interval = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.slave_connection = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.sqlite_synchronous = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.synchronous_reader = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] database.use_db_reconnect = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_tracing.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.connection_string = messaging:// {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.es_doc_type = notification {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.es_scroll_size = 10000 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.es_scroll_time = 2m {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.filter_error_trace = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.hmac_keys = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.sentinel_service_name = mymaster {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.socket_timeout = 0.1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.trace_requests = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler.trace_sqlalchemy = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler_jaeger.process_tags = {} {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler_jaeger.service_name_prefix = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] profiler_otlp.service_name_prefix = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.enforce_new_defaults = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.policy_default_rule = default {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.policy_file = policy.yaml {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_policy.remote_timeout = 60.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.group = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.helper_command = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85893) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: WARNING cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] privsep_osbrick.user = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: WARNING cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.group = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.helper_command = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Running cmd (subprocess): mount.quobyte {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] cinder_sys_admin.user = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.auth_section = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.auth_type = password {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.cafile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.collect_timing = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.send_service_user_token = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.split_loggers = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.tls_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] service_user.tls_min_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.auth_section = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.auth_type = password {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.collect_timing = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.region_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.split_loggers = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.tls_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] glance.tls_min_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.backend_availability_zone = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.chap_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.chap_username = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.disk_geometry = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_client_cert = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_client_cert_key = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_data_namespace = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.driver_use_ssl = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.enable_unsupported_driver = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.extra_capabilities = {} {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.filter_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.goodness_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iscsi_target_flags = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iscsi_write_cache = on {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iser_helper = tgtadm {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iser_port = 3260 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_host = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_login = admin {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_mount_options = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_private_key = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_share_path = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_ssh_port = 22 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.num_shell_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.nvmet_port_id = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_client_cfg = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.quobyte_volume_url = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.replication_device = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.report_discard_supported = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.reserved_percentage = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.scst_target_driver = iscsi {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.scst_target_iqn_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.storage_protocol = iSCSI {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_helper = tgtadm {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_port = 3260 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_protocol = iscsi {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.trace_flags = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.unique_fqdn_network = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.use_chap_auth = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_backend_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_clear = zero {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_clear_ionice = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_clear_size = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_reports.file_event_handler = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_reports.log_dir = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.backend_availability_zone = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.backend_host = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.chap_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.chap_username = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.chiscsi_conf = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.disk_geometry = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_client_cert = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_client_cert_key = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_data_namespace = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.driver_use_ssl = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.extra_capabilities = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.filter_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.goodness_function = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iscsi_target_flags = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iscsi_write_cache = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iser_helper = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iser_ip_address = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iser_port = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.iser_target_prefix = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_host = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_login = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_mount_options = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_password = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_private_key = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_share_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_ssh_port = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.num_shell_tries = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nvmet_ns_id = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.nvmet_port_id = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.replication_device = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.report_discard_supported = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.reserved_percentage = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.scst_target_driver = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.storage_protocol = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_helper = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_ip_address = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_port = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_prefix = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_protocol = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.trace_flags = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.unique_fqdn_network = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.use_chap_auth = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_clear = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_clear_ionice = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_clear_size = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] QuobyteHD.volumes_dir = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.ssl_version = {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_notifications.driver = [] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_notifications.retry = -1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] oslo_messaging_notifications.transport_url = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] key_manager.fixed_key = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack quobyte-client[85898]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.barbican_api_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.barbican_endpoint = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.barbican_endpoint_type = public {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.barbican_region_name = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.cafile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack quobyte-client[85898]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.collect_timing = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.number_of_retries = 60 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.retry_delay = 1 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.send_service_user_token = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.split_loggers = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.tls_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.tls_min_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.verify_ssl = True {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican.verify_ssl_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.auth_section = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.auth_type = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.cafile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.certfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.collect_timing = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.insecure = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.keyfile = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.split_loggers = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.timeout = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.tls_ciphers = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] barbican_service_user.tls_min_version = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.approle_role_id = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.approle_secret_id = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.auth_method = approle {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.auth_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.kv_mountpoint = secret {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.kv_path = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.kv_version = 2 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.namespace = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.root_token_id = **** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.ssl_ca_crt_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=85893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.timeout = 60.0 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.token_file = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.token_role = None {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: INFO cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 ... Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.use_ssl = False {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 -c /etc/quobyte/client-cinder.cfg {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:16 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] ******************************************************************************** {{(pid=85677) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 12:03:16 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 -c /etc/quobyte/client-cinder.cfg Nov 03 12:03:16 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:16 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.422s {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:16 devstack cinder-volume[85893]: INFO cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 succeeded Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=85893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.437s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:16 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:16 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:16 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:17 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.231s {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.volume.driver [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Driver hasn't implemented _init_vendor_properties() Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.volume.driver [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.73637008667, 'free_capacity_gb': 1773.73637008667, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85893) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_db.sqlalchemy.engines [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG dbcounter [-] [85893] Writer thread running {{(pid=85893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.db.api [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Building query based on filter {{(pid=85893) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.image.image_utils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85893) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.keymgr.migration [None req-7e60877b-7aa7-49e3-b041-40ddba029466 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=85893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=85893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:17 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:17 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:17 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.238s {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Notifying Schedulers of capabilities ... {{(pid=85893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Driver initialization completed successfully. Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Initiating service 3 cleanup Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Service 3 cleanup completed. Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.service [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Creating RPC server for service cinder-volume {{(pid=85893) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.service [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85893) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=85893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG cinder.volume.drivers.quobyte [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=85893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:17 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:17 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:17 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:17 devstack cinder-volume[85893]: DEBUG oslo_concurrency.processutils [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.263s {{(pid=85893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:17 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-270b1dac-fc57-4a85-95a9-fd2bbb74ca4d None None] Driver post RPC initialization completed successfully. Nov 03 12:03:22 devstack cinder-volume[85677]: INFO oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Caught SIGTERM, stopping children Nov 03 12:03:22 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Acquiring lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:22 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Acquired lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:22 devstack cinder-volume[85677]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Releasing lock "singleton_lock" {{(pid=85677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:22 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Stop services. {{(pid=85677) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 12:03:22 devstack cinder-volume[85677]: DEBUG oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Killing children. {{(pid=85677) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 12:03:22 devstack cinder-volume[85677]: INFO oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Waiting on 1 children to exit Nov 03 12:03:25 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Acquiring lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:25 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Acquired lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:25 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Releasing lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:25 devstack cinder-volume[85893]: WARNING amqp [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:03:25 devstack cinder-volume[85893]: WARNING amqp [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:03:25 devstack cinder-volume[85677]: INFO oslo_service.backend._eventlet.service [None req-0cce07a1-4b0a-4a94-9544-4dfeea13fe0a None None] Child 85893 exited with status 0 Nov 03 12:03:26 devstack cinder-volume[86211]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 12:03:26 devstack cinder-volume[86211]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:03:26 devstack cinder-volume[86211]: we strongly recommend against using it for new projects. Nov 03 12:03:26 devstack cinder-volume[86211]: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:03:26 devstack cinder-volume[86211]: framework. For more detail see Nov 03 12:03:26 devstack cinder-volume[86211]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:03:26 devstack cinder-volume[86211]: import eventlet # noqa Nov 03 12:03:29 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:03:29 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:03:29 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:03:30 devstack cinder-volume[86211]: INFO dbcounter [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Registered counter for database cinder Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG dbcounter [-] [86211] Writer thread running {{(pid=86211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:03:30 devstack cinder-volume[86211]: INFO cinder.rpc [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 12:03:30 devstack cinder-volume[86211]: INFO cinder.rpc [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:30 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Determined volume DB was empty at startup. Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG cinder.volume.manager [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86211) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 12:03:30 devstack cinder-volume[86211]: WARNING stevedore.named [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:03:30 devstack cinder-volume[86211]: WARNING castellan.key_manager [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:03:30 devstack cinder-volume[86211]: WARNING cinder.keymgr.conf_key_mgr [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:03:30 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:30 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Starting 1 workers Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Started child 86561 {{(pid=86211) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Full set of CONF: {{(pid=86211) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] Configuration options gathered from: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] ================================================================================ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] allow_availability_zone_fallback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] allow_compression_on_image_upload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] allowed_direct_url_schemes = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] api_rate_limit = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] auth_strategy = keystone {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_host = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_stats_polling_interval = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backup_api_class = cinder.backup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backup_name_template = backup-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backup_use_same_host = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backup_use_temp_snapshot = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86561]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] chap_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] chap_username = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_internal_tenant_project_id = 230d1db5a5eb476396f5dbe0493ad097 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_internal_tenant_user_id = 34d3726fc2ae42a293c4dd74cebba8ea {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cluster = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] compression_format = gzip {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] compute_api_class = cinder.compute.nova.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] config_dir = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] config_source = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] control_exchange = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] debug = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] default_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] default_group_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] default_volume_type = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] disk_geometry = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_client_cert = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_ssl_cert_verify = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] driver_use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] enable_new_services = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] enable_unsupported_driver = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] enabled_backends = ['QuobyteHD'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] filter_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_api_insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_api_ssl_compression = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_ca_certificates_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_catalog_info = image:glance:publicURL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_num_retries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance_request_timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] goodness_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] graceful_shutdown_timeout = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] group_api_class = cinder.group.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] host = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_compress_on_upload = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_conversion_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_conversion_cpu_limit = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_conversion_disable = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_introspection_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_introspection_cpu_limit = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_volume_cache_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_volume_cache_max_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] init_host_max_objects_retrieval = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] instance_format = [instance: %(uuid)s] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iscsi_target_flags = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iscsi_write_cache = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iser_helper = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iser_ip_address = 192.168.122.148 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iser_port = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_color = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_config_append = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_dir = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_options = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_rotate_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_rotate_interval_type = days {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] log_rotation_type = none {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] max_age = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] max_logfile_count = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] max_logfile_size_mb = 200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] max_over_subscription_ratio = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] message_reap_interval = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] message_ttl = 2592000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] migration_create_volume_timeout_secs = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] monkey_patch = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] monkey_patch_modules = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] my_ip = 192.168.122.148 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] no_snapshot_gb_quota = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] num_iser_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] num_shell_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] num_volume_device_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] nvmeof_conn_info_version = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] nvmet_ns_id = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] nvmet_port_id = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_max_limit = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_ext_list = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_listen_port = 8776 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] osapi_volume_workers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] per_volume_size_limit = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] periodic_fuzzy_delay = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] periodic_interval = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] public_endpoint = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] publish_errors = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_backup_gigabytes = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_backups = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_gigabytes = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_groups = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_snapshots = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] quota_volumes = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] rate_limit_burst = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] rate_limit_except_level = CRITICAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] rate_limit_interval = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] reinit_driver_count = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] replication_device = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] report_discard_supported = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] report_interval = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] reservation_clean_interval = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] reservation_expire = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] reserved_image_namespaces = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] reserved_percentage = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86561) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] rpc_response_timeout = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] run_external_periodic_tasks = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] scst_target_driver = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_down_time = 720 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] shell_completion = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] snapshot_name_template = snapshot-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] state_path = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] storage_availability_zone = nova {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] storage_protocol = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] syslog_log_facility = LOG_USER {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_helper = lioadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_ip_address = 192.168.122.148 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_port = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_protocol = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] target_secondary_ip_addresses = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] trace_flags = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] transport_url = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] until_refresh = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_chap_auth = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_default_quota_class = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_journal = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_json = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_stderr = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] use_syslog = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] verify_glance_signatures = enabled {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_api_class = cinder.volume.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_backend_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_clear = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_clear_ionice = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_clear_size = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_copy_bps_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_dd_blocksize = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_name_template = volume-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_service_inithost_offload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volume_usage_audit_period = month {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] zoning_mode = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_concurrency.disable_process_locking = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.auth_type = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.auth_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.cache = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.include_service_catalog = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.interface = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcache_username = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.region_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.service_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.backend = dogpile.cache.null {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.backend_argument = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.backend_expiration_time = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.config_prefix = cache.oslo {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.debug_cache_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.enable_retry_client = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.enable_socket_keepalive = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.expiration_time = 600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.hashclient_retry_attempts = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_dead_retry = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_pool_maxsize = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_sasl_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.proxies = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.redis_db = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.redis_server = localhost:6379 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.retry_attempts = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.retry_delay = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.socket_keepalive_count = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.socket_keepalive_idle = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.socket_keepalive_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.socket_timeout = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.tls_allowed_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.tls_cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.tls_certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.tls_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.tls_keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cache.username = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] coordination.backend_url = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.asyncio_connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.asyncio_slave_connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.backend = sqlalchemy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.connection_debug = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.connection_parameters = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.connection_recycle_time = 3600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.connection_trace = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.db_inc_retry_interval = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.db_max_retries = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.db_max_retry_interval = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.db_retry_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.max_overflow = 50 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.max_pool_size = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.max_retries = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.mysql_wsrep_sync_wait = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.pool_timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.retry_interval = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.slave_connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.sqlite_synchronous = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.synchronous_reader = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] database.use_db_reconnect = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_tracing.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.connection_string = messaging:// {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.es_doc_type = notification {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.es_scroll_size = 10000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.es_scroll_time = 2m {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.filter_error_trace = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.hmac_keys = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.socket_timeout = 0.1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.trace_requests = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler.trace_sqlalchemy = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler_jaeger.process_tags = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler_jaeger.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] profiler_otlp.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.enforce_new_defaults = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.policy_default_rule = default {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.policy_file = policy.yaml {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86561) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 12:03:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.group = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] privsep_osbrick.user = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.group = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:30 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] cinder_sys_admin.user = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.auth_type = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.send_service_user_token = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] service_user.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.auth_type = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.region_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] glance.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.chap_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.chap_username = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.disk_geometry = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_client_cert = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.driver_use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.extra_capabilities = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.filter_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.goodness_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iscsi_target_flags = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iscsi_write_cache = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iser_helper = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iser_port = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_host = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_login = admin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_mount_options = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_private_key = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_share_path = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.num_shell_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.quobyte_volume_url = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.replication_device = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.report_discard_supported = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.reserved_percentage = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_helper = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_port = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_protocol = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.trace_flags = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.unique_fqdn_network = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.use_chap_auth = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_backend_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_clear = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_clear_ionice = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_clear_size = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_reports.file_event_handler = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_reports.log_dir = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.backend_host = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.chap_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.chap_username = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.chiscsi_conf = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.disk_geometry = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_client_cert = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.driver_use_ssl = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.extra_capabilities = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.filter_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.goodness_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack quobyte-client[86562]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iser_helper = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack quobyte-client[86562]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iser_ip_address = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iser_port = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.iser_target_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_host = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_login = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_mount_options = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_private_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_share_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_ssh_port = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.num_shell_tries = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.nvmet_port_id = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.replication_device = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.report_discard_supported = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.reserved_percentage = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.scst_target_driver = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.storage_protocol = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_helper = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_ip_address = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_port = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_protocol = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.trace_flags = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.use_chap_auth = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_clear = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_clear_size = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] QuobyteHD.volumes_dir = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_notifications.driver = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_notifications.retry = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] key_manager.fixed_key = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.barbican_api_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.barbican_endpoint = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.barbican_endpoint_type = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.barbican_region_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.number_of_retries = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.retry_delay = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.send_service_user_token = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.verify_ssl = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican.verify_ssl_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.auth_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:31 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] barbican_service_user.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.approle_role_id = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.approle_secret_id = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.auth_method = approle {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.auth_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.kv_mountpoint = secret {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.kv_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.kv_version = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.root_token_id = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.ssl_ca_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.timeout = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.token_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.token_role = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:03:31 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-537dc9ba-062f-438b-90fe-b8ede33b83dc None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 12:03:31 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.volume.driver [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.driver [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.73637008667, 'free_capacity_gb': 1773.73637008667, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_db.sqlalchemy.engines [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writer thread running {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.db.api [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Building query based on filter {{(pid=86561) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.keymgr.migration [None req-09b79b6d-a88a-4f59-b29f-900d0690a9d4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 12:03:31 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:31 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:31 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.236s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Driver initialization completed successfully. Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Initiating service 3 cleanup Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Service 3 cleanup completed. Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.service [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Creating RPC server for service cinder-volume {{(pid=86561) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.service [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86561) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 12:03:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:03:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:03:31 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:03:31 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:03:32 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Nov 03 12:03:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:03:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bf509fb6-98d0-4750-83c5-98857facd5f0 None None] Driver post RPC initialization completed successfully. Nov 03 12:03:40 devstack cinder-volume[86211]: DEBUG dbcounter [-] [86211] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:03:41 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:03:42 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:04:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:04:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 6 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:04:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Flow 'volume_create_manager' (e28450e9-826f-45e9-99e4-192c24d23999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0d0815-1142-4046-8845-9761880a7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0d0815-1142-4046-8845-9761880a7140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-991825808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328f20a-86cc-4613-8be9-e034da4976ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4350c0a475de42dab5067fc33e82a7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:29Z,use_quota=True,user_id='76d28258bb0e4a1a93d4774962b5e98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62250da9-5ad9-4dc9-9cd9-4345dc4176f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62250da9-5ad9-4dc9-9cd9-4345dc4176f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b83d2f-1e7b-4ba4-abbb-b2cef70c263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b83d2f-1e7b-4ba4-abbb-b2cef70c263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e328f20a-86cc-4613-8be9-e034da4976ec', 'volume_name': 'volume-e328f20a-86cc-4613-8be9-e034da4976ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8d5d97-e9fe-4e06-8a1e-0335ac72381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8d5d97-e9fe-4e06-8a1e-0335ac72381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81129ef3-0ea6-4cf5-a2fa-450eb3521594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Volume e328f20a-86cc-4613-8be9-e034da4976ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e328f20a-86cc-4613-8be9-e034da4976ec', 'volume_size': 1} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-991825808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328f20a-86cc-4613-8be9-e034da4976ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4350c0a475de42dab5067fc33e82a7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:29Z,use_quota=True,user_id='76d28258bb0e4a1a93d4774962b5e98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Creating volume e328f20a-86cc-4613-8be9-e034da4976ec {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:04:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:29 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec 1073741824 Nov 03 12:04:29 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Flow 'volume_create_manager' (476efec0-9f12-4eb5-9723-27c8aa5fdaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd744c-6d3b-409e-8129-135c12a6c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd744c-6d3b-409e-8129-135c12a6c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-410493720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2bf6a8-39fe-41e9-8687-78f48008fc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8540f0487f146cc874a66746bd69c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:29Z,use_quota=True,user_id='9a3d267f7aac49d4bb7161d0ac59986b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a823c-f9b5-4105-bffc-d9bb58857b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a823c-f9b5-4105-bffc-d9bb58857b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d55839-18f5-48ee-9eab-0c12f6c72a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d55839-18f5-48ee-9eab-0c12f6c72a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2bf6a8-39fe-41e9-8687-78f48008fc35', 'volume_name': 'volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a28d74-9b09-421c-a17c-19c4459359ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a28d74-9b09-421c-a17c-19c4459359ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248fd757-85fa-4254-b420-7cdead68a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Volume bb2bf6a8-39fe-41e9-8687-78f48008fc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35', 'volume_size': 1} Nov 03 12:04:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:30 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec 1073741824" returned: 0 in 0.833s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:30 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec Nov 03 12:04:30 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:30 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec" returned: 0 in 0.647s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-410493720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2bf6a8-39fe-41e9-8687-78f48008fc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8540f0487f146cc874a66746bd69c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:29Z,use_quota=True,user_id='9a3d267f7aac49d4bb7161d0ac59986b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Creating volume bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:04:30 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:04:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81129ef3-0ea6-4cf5-a2fa-450eb3521594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e328f20a-86cc-4613-8be9-e034da4976ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:31 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 1073741824 Nov 03 12:04:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dbb6f3-c523-44ca-bbed-2ca587623039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:31 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Volume volume-e328f20a-86cc-4613-8be9-e034da4976ec (e328f20a-86cc-4613-8be9-e034da4976ec): created successfully Nov 03 12:04:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dbb6f3-c523-44ca-bbed-2ca587623039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Flow 'volume_create_manager' (e28450e9-826f-45e9-99e4-192c24d23999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b6e99539-d37c-4860-b5aa-74a9dc3be6fb tempest-DeleteServersTestJSON-604301865 None] Created volume successfully. Nov 03 12:04:31 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 1073741824" returned: 0 in 0.945s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:32 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 Nov 03 12:04:32 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:32 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248fd757-85fa-4254-b420-7cdead68a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d24ea-17c7-46ce-a4b9-54bb81eec2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Volume volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 (bb2bf6a8-39fe-41e9-8687-78f48008fc35): created successfully Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d24ea-17c7-46ce-a4b9-54bb81eec2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Flow 'volume_create_manager' (476efec0-9f12-4eb5-9723-27c8aa5fdaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-2ef1d42d-eb1f-46bc-acf8-1f5e9b26824c req-8c28f7ba-8bc4-4bbd-a456-e4c2b27ec5d3 tempest-VolumesSnapshotsTestJSON-1734776460 None] Created volume successfully. Nov 03 12:04:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Creating offline snapshot c770e21c-d5a9-4134-a4ce-60e035b7643f of volume bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:04:33 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8vz4fbau/privsep.sock'] Nov 03 12:04:33 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8vz4fbau/privsep.sock Nov 03 12:04:33 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 12:04:34 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 12:04:34 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:34 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Spawned new privsep daemon via rootwrap Nov 03 12:04:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Accepted privsep connection to /tmp/tmp8vz4fbau/privsep.sock {{(pid=86561) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 12:04:34 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 12:04:34 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 12:04:34 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 12:04:34 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87644 Nov 03 12:04:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8264dcc0-3186-4e2d-b086-ec13f500d3dd]: (2,) {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[80387c5e-1b3f-40a3-8ad9-38d009e91150]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:34 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 Nov 03 12:04:34 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:35 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35" returned: 0 in 0.394s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:35 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f 1G Nov 03 12:04:35 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:35 devstack cinder-volume[86561]: WARNING py.warnings [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 12:04:35 devstack cinder-volume[86561]: .first() Nov 03 12:04:35 devstack cinder-volume[86561]: Nov 03 12:04:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:35 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f 1G" returned: 0 in 0.548s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:35 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f Nov 03 12:04:35 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:35 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:36 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f is being set with open permissions: ugo+rw Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:36 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f Nov 03 12:04:36 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:36 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:36 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info Nov 03 12:04:36 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:36 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info" returned: 0 in 0.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:36 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info is being set with open permissions: ugo+rw Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:36 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info Nov 03 12:04:36 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:36 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.info" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.689s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.508s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-7a6d2218-3823-4961-940a-0a8b5f7bf020 req-ea7f325f-f78b-4e43-8856-fe522be241de tempest-VolumesSnapshotsTestJSON-1734776460 None] Create snapshot completed successfully Nov 03 12:04:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.110s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-e328f20a-86cc-4613-8be9-e034da4976ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00edf893-18fe-4395-a185-0b06aa13b3c9', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:04:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-0ccefc3a-44f2-471e-b502-415547e94561 req-56d714c4-f426-4158-9f91-9a2bae2998b0 tempest-DeleteServersTestJSON-604301865 None] attachment_update completed successfully. Nov 03 12:04:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "cinder-c770e21c-d5a9-4134-a4ce-60e035b7643f-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-c770e21c-d5a9-4134-a4ce-60e035b7643f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "cinder-quobyte-c770e21c-d5a9-4134-a4ce-60e035b7643f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-c770e21c-d5a9-4134-a4ce-60e035b7643f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Deleting offline snapshot c770e21c-d5a9-4134-a4ce-60e035b7643f of volume bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] snapshot_file for this snap is: volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b2fdd6-8cdf-4eb5-8b5a-0e023c124669]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:38 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f Nov 03 12:04:38 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:38 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7926b3e-246e-4361-a8f6-70d0cfe07e8c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:38 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 Nov 03 12:04:38 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:38 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35" returned: 0 in 0.373s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:38 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f Nov 03 12:04:38 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:39 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f" returned: 0 in 0.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:39 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f Nov 03 12:04:39 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:39 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35.c770e21c-d5a9-4134-a4ce-60e035b7643f" returned: 0 in 0.423s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-c770e21c-d5a9-4134-a4ce-60e035b7643f" released by "_delete_snapshot" :: held 1.818s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" released by "delete_snapshot" :: held 1.855s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:39 devstack cinder-volume[86561]: WARNING cinder.quota [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:04:39 devstack cinder-volume[86561]: WARNING cinder.quota [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:04:39 devstack cinder-volume[86561]: DEBUG cinder.quota [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Created reservations ['3c466d99-3d2b-488a-ae2d-915d2bdb3369', '32534a88-be6f-44ac-b6b5-55d38da95043', '0eb753d1-bdd6-474f-9e61-d3b31674c37d', '0fdac8a4-8cbc-4297-9d19-e79e19a69331'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:04:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Delete snapshot completed successfully. Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-b0070154-ec4a-4d2a-8b5a-ad4189eb4ece req-e7e25cfe-637c-489c-8ac6-34ad4f4d9c86 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-c770e21c-d5a9-4134-a4ce-60e035b7643f-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "cinder-bb2bf6a8-39fe-41e9-8687-78f48008fc35-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-bb2bf6a8-39fe-41e9-8687-78f48008fc35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3b6e9-922b-4d02-9481-f4b68ea94ed3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:40 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 Nov 03 12:04:40 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:40 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35" returned: 0 in 0.509s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:41 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35 Nov 03 12:04:41 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:41 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb2bf6a8-39fe-41e9-8687-78f48008fc35" returned: 0 in 0.325s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-cc1475de-196a-4702-8fec-090e8b25b2f0 req-0fea2d9f-6eb8-40d0-ba04-0643bfe8d6f6 tempest-DeleteServersTestJSON-604301865 None] Terminate volume connection completed successfully. Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-cc1475de-196a-4702-8fec-090e8b25b2f0 req-0fea2d9f-6eb8-40d0-ba04-0643bfe8d6f6 tempest-DeleteServersTestJSON-604301865 None] Deleting attachment 00edf893-18fe-4395-a185-0b06aa13b3c9. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-quobyte-bb2bf6a8-39fe-41e9-8687-78f48008fc35" released by "delete_volume" :: held 0.934s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:41 devstack cinder-volume[86561]: WARNING cinder.quota [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.quota [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Created reservations ['88ec52ae-e2f0-46c4-8e30-8d52d81688b9', 'b2885980-8c6a-43ff-ad73-0357651079b3', 'c9d01160-3ee6-4ce3-b2e8-d8739ce69830', 'a7443576-b402-41dd-9f6a-ef14f128c981'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:41 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:04:41 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:41 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.manager [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:04:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Deleted volume successfully. Nov 03 12:04:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-77d75149-ba36-44f5-8c0d-67c08b699f54 req-249f277b-dd25-424a-86c4-b4d3c6c34e42 tempest-VolumesSnapshotsTestJSON-1734776460 None] Lock "cinder-bb2bf6a8-39fe-41e9-8687-78f48008fc35-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "cinder-e328f20a-86cc-4613-8be9-e034da4976ec-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "cinder-e328f20a-86cc-4613-8be9-e034da4976ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "cinder-quobyte-e328f20a-86cc-4613-8be9-e034da4976ec" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "cinder-quobyte-e328f20a-86cc-4613-8be9-e034da4976ec" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d60959-2715-4d3b-b140-b167ad5ab025]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:44 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec Nov 03 12:04:44 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:44 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec" returned: 0 in 0.448s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:44 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec Nov 03 12:04:44 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:44 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e328f20a-86cc-4613-8be9-e034da4976ec" returned: 0 in 0.325s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "cinder-quobyte-e328f20a-86cc-4613-8be9-e034da4976ec" released by "delete_volume" :: held 0.849s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Created reservations ['23f4480e-fda1-4e94-9c70-2266b9f450f8', 'c4595f0d-ad02-44b1-9e02-9ef48ecf8f9c', '8bb35242-c0b7-4e61-8430-ea9f73f78465', '672a090c-784a-43a3-bbe0-0f621182f055'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:44 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:04:44 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:45 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:45 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:04:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Deleted volume successfully. Nov 03 12:04:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0767c71-4e82-4b97-b535-7438ea8f1037 tempest-DeleteServersTestJSON-604301865 None] Lock "cinder-e328f20a-86cc-4613-8be9-e034da4976ec-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:04:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-503f58bf-b78e-46ef-89bd-a71bde525d34 tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-280695595: creating Nov 03 12:04:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-503f58bf-b78e-46ef-89bd-a71bde525d34 tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-280695595: created successfully Nov 03 12:04:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-503f58bf-b78e-46ef-89bd-a71bde525d34 tempest-GroupSnapshotsTest-375493673 None] Create group completed successfully. Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (80a2f73d-2024-4b55-989c-0d959ae7b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506ef31-362d-406d-b648-b686e609ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506ef31-362d-406d-b648-b686e609ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615866253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f1ea54-38c8-4f2c-995f-8fe395b37713,host='devstack@QuobyteHD#QuobyteHD',id=4d537526-299b-4106-8da2-1c551a0c9e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:50Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23cdd48c-5bd9-4964-a3f5-ab57cb2ace09),volume_type_id=23cdd48c-5bd9-4964-a3f5-ab57cb2ace09)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6deb6-b813-4aba-af65-81fd53733e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6deb6-b813-4aba-af65-81fd53733e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846293fb-2344-46cc-91d2-1b43817ae0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846293fb-2344-46cc-91d2-1b43817ae0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d537526-299b-4106-8da2-1c551a0c9e51', 'volume_name': 'volume-4d537526-299b-4106-8da2-1c551a0c9e51', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7ab825-7cc7-4510-b020-06efab5373c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7ab825-7cc7-4510-b020-06efab5373c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbed38e-e14b-4ee7-b647-9fa55bfb0503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Volume 4d537526-299b-4106-8da2-1c551a0c9e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d537526-299b-4106-8da2-1c551a0c9e51', 'volume_size': 1} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15f1ea54-38c8-4f2c-995f-8fe395b37713,created_at=2026-11-03T11:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615866253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f1ea54-38c8-4f2c-995f-8fe395b37713,host='devstack@QuobyteHD#QuobyteHD',id=4d537526-299b-4106-8da2-1c551a0c9e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:50Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23cdd48c-5bd9-4964-a3f5-ab57cb2ace09),volume_type_id=23cdd48c-5bd9-4964-a3f5-ab57cb2ace09)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Creating volume 4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:04:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:04:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:49 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 1073741824 Nov 03 12:04:49 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:50 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 1073741824" returned: 0 in 0.594s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:50 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:04:50 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Flow 'volume_create_manager' (5e2b439a-1618-447f-b6e2-0d8cdaa6588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1acc4f-2da8-4846-ab26-7ab54a5d6689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1acc4f-2da8-4846-ab26-7ab54a5d6689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-793893523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52af1292-979e-400d-b8fa-112cd6ddc340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c240a59d151b46abae43caa25d25144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:51Z,use_quota=True,user_id='c341f71cfb99463e8d386d898b7490a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70a36af-584a-45df-801c-653d02c74994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70a36af-584a-45df-801c-653d02c74994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d117e420-d016-47af-bee6-944ad918998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d117e420-d016-47af-bee6-944ad918998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52af1292-979e-400d-b8fa-112cd6ddc340', 'volume_name': 'volume-52af1292-979e-400d-b8fa-112cd6ddc340', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2dfd9e-fed9-436d-bfb3-34e2e4ba9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2dfd9e-fed9-436d-bfb3-34e2e4ba9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1b3e49-3ae6-4ede-b3e3-91ba017a1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Volume 52af1292-979e-400d-b8fa-112cd6ddc340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52af1292-979e-400d-b8fa-112cd6ddc340', 'volume_size': 1} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:50 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.521s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-793893523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52af1292-979e-400d-b8fa-112cd6ddc340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c240a59d151b46abae43caa25d25144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:04:51Z,use_quota=True,user_id='c341f71cfb99463e8d386d898b7490a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Creating volume 52af1292-979e-400d-b8fa-112cd6ddc340 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:04:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbed38e-e14b-4ee7-b647-9fa55bfb0503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d537526-299b-4106-8da2-1c551a0c9e51', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:50 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 1073741824 Nov 03 12:04:50 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe470d79-1bf8-456f-a627-1114c3fa2c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Volume volume-4d537526-299b-4106-8da2-1c551a0c9e51 (4d537526-299b-4106-8da2-1c551a0c9e51): created successfully Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe470d79-1bf8-456f-a627-1114c3fa2c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (80a2f73d-2024-4b55-989c-0d959ae7b224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8b1a5215-ba8e-45e2-9a6a-d9a55764cac9 tempest-GroupSnapshotsTest-375493673 None] Created volume successfully. Nov 03 12:04:51 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 1073741824" returned: 0 in 0.712s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:51 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 Nov 03 12:04:51 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:51 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340" returned: 0 in 0.316s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:04:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1b3e49-3ae6-4ede-b3e3-91ba017a1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52af1292-979e-400d-b8fa-112cd6ddc340', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbfe9f9-d440-4350-875b-89e09ea8d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:04:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Volume volume-52af1292-979e-400d-b8fa-112cd6ddc340 (52af1292-979e-400d-b8fa-112cd6ddc340): created successfully Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbfe9f9-d440-4350-875b-89e09ea8d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Flow 'volume_create_manager' (5e2b439a-1618-447f-b6e2-0d8cdaa6588f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:04:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bcd37c9d-736b-4807-ab55-7196cf08acde tempest-ServerActionsTestOtherA-438295809 None] Created volume successfully. Nov 03 12:04:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] GroupSnapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: creating. Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Group snapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Creating offline snapshot 27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e of volume 4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e9d19-2e11-4f2a-b337-c1fae7093a2a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:52 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:04:52 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:52 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.428s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:53 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e 1G Nov 03 12:04:53 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:53 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e 1G" returned: 0 in 0.613s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d537526-299b-4106-8da2-1c551a0c9e51 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:53 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d537526-299b-4106-8da2-1c551a0c9e51 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:04:53 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:54 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d537526-299b-4106-8da2-1c551a0c9e51 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.435s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:54 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:54 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:04:54 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:54 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.284s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:54 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info Nov 03 12:04:54 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:54 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info" returned: 0 in 0.341s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:54 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:04:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:54 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info Nov 03 12:04:54 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:55 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.info" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-00b72c5d-cb22-4f1c-8e3e-b48279f5b535 tempest-GroupSnapshotsTest-375493673 None] group_snapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: created successfully Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e-7d453793-08cf-4ad4-a8a2-43625be013b2" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e-7d453793-08cf-4ad4-a8a2-43625be013b2" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Creating volume 7d453793-08cf-4ad4-a8a2-43625be013b2 from snapshot 27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] snapshot: 27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e, volume: 7d453793-08cf-4ad4-a8a2-43625be013b2, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:04:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4e0a34-7a95-4468-a804-b42cb2e76e0f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:57 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:04:57 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:57 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.543s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d537526-299b-4106-8da2-1c551a0c9e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056c06b-545a-490e-8fe1-d39aedcac207]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:04:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:57 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:04:57 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:04:57 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Nov 03 12:04:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.419s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:04:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:04:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:04:58 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:04:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:04:58 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 Nov 03 12:04:58 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:06 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=43,cinder:SELECT=48,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:05:06 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=41,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:05:07 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2" returned: 0 in 9.660s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:07 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51, size 1024.00 MB, duration 9.66 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:05:07 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Converted 1024.00 MB image at 105.99 MB/s Nov 03 12:05:07 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:07 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 Nov 03 12:05:07 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:08 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2" returned: 0 in 0.392s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" released by "_copy_volume_from_snapshot" :: held 11.176s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e-7d453793-08cf-4ad4-a8a2-43625be013b2" released by "_create_volume_from_snapshot" :: held 11.283s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.315s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-36377dda-150f-49b1-b5be-b807f0e19e8e tempest-GroupSnapshotsTest-375493673 None] Create group from source-snapshot-d9f25f06-69eb-42c7-8603-2d312b0815b6 completed successfully. Nov 03 12:05:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab351e-3448-4840-96ef-848699a6eafb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:10 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 Nov 03 12:05:10 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:10 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2" returned: 0 in 0.460s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:10 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2 Nov 03 12:05:10 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:10 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d453793-08cf-4ad4-a8a2-43625be013b2" returned: 0 in 0.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7d453793-08cf-4ad4-a8a2-43625be013b2" released by "delete_volume" :: held 0.829s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Created reservations ['3e730e60-16bb-43d1-ba68-7ec21f1384c2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:10 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-674527015 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-674527015, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:10 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-674527015 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-674527015, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Created reservations ['b6fb63ac-02d2-42d3-b9c8-a8e340e1368a', 'c2a93dcb-52a7-4a9a-a136-d1100e3cd1cb', '305fc2b1-2694-4a5f-a778-2443486d5742', '39c1244f-b285-42dc-bd41-e2ff493c4089'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:11 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:05:11 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] group_snapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: deleting Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] group_snapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:11 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6dc7ef3-0d3d-4ce3-a575-c692fff6d8af tempest-GroupSnapshotsTest-375493673 None] Delete group completed successfully. Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Deleting offline snapshot 27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e of volume 4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] snapshot_file for this snap is: volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ea427-0af4-4a9a-88a3-f927e3b93d41]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:11 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:05:11 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:12 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d537526-299b-4106-8da2-1c551a0c9e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21cd89c-bf1a-4cd3-bbbb-c7f737549cd3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:12 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:05:12 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:12 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.601s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:12 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:05:12 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:13 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.478s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:13 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e Nov 03 12:05:13 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:13 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51.27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" returned: 0 in 0.495s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-27c43f16-c4fb-4f25-a45a-b74a5ad7ed8e" released by "_delete_snapshot" :: held 2.209s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" released by "delete_snapshot" :: held 2.247s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:13 devstack cinder-volume[86561]: WARNING cinder.quota [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-674527015 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-674527015, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['45b54720-edc2-4628-8589-bc4206233a45', '1fb8697d-fe4d-4af0-b9da-af0efa3b4f0a', '80d9da40-ead9-403f-bf9e-9a81e5ddfd4f', '75db6878-bd47-47c9-b9c6-a86373e5be8a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-059939bc-c5d9-4a8f-9a5f-c62f3b7dc3b6 tempest-GroupSnapshotsTest-375493673 None] group_snapshot d9f25f06-69eb-42c7-8603-2d312b0815b6: deleted successfully Nov 03 12:05:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b2aa2-4d2f-463e-a750-7d6efc414d3d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:15 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:05:15 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:16 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.695s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:16 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51 Nov 03 12:05:16 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:16 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4d537526-299b-4106-8da2-1c551a0c9e51" returned: 0 in 0.446s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-4d537526-299b-4106-8da2-1c551a0c9e51" released by "delete_volume" :: held 1.285s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Created reservations ['29e87709-a8b8-42e3-b343-250962aeed29'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:17 devstack cinder-volume[86561]: WARNING cinder.db.api [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-674527015'] Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Created reservations ['9f032404-4dd4-4a81-b9a4-7ba85cfad548', 'b2a13fb6-24b0-49d2-ab8d-830efef8a9d3', '7fc229ea-714e-4205-ad49-33e3c10f2112', '4dfc7c30-5252-4908-b049-835dcc9bee15'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:17 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:05:17 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:17 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.509s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:05:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a43360f4-7c0e-4d9c-afe0-63578f4e6b2a tempest-GroupSnapshotsTest-375493673 None] Delete group completed successfully. Nov 03 12:05:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88ff4b77-dd39-4f94-97ba-e5e9616460d9 tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-648854732: creating Nov 03 12:05:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88ff4b77-dd39-4f94-97ba-e5e9616460d9 tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-648854732: created successfully Nov 03 12:05:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88ff4b77-dd39-4f94-97ba-e5e9616460d9 tempest-GroupSnapshotsTest-375493673 None] Create group completed successfully. Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (d9f1ff68-1fd7-42c0-b92d-b194f6278e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24bffd2-59ed-48be-820a-443113079086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24bffd2-59ed-48be-820a-443113079086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588946330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be74434-9c52-4b57-ac05-b1d17521f82f,host='devstack@QuobyteHD#QuobyteHD',id=0653bccb-bee9-4f73-8ac0-d9c2067c4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:21Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8a702d-616a-442d-ad59-6e141aec7dcd),volume_type_id=8b8a702d-616a-442d-ad59-6e141aec7dcd)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4fffbc-5ade-4070-8876-e992069f7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4fffbc-5ade-4070-8876-e992069f7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05195106-d5b1-4618-9c34-229da73c827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05195106-d5b1-4618-9c34-229da73c827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0653bccb-bee9-4f73-8ac0-d9c2067c4d3f', 'volume_name': 'volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18e4226-51bf-4cd6-b4f2-8e27a5478623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18e4226-51bf-4cd6-b4f2-8e27a5478623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734bb8e4-6fba-4eb3-85e1-32d71fcde19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Volume 0653bccb-bee9-4f73-8ac0-d9c2067c4d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f', 'volume_size': 1} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2be74434-9c52-4b57-ac05-b1d17521f82f,created_at=2026-11-03T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588946330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be74434-9c52-4b57-ac05-b1d17521f82f,host='devstack@QuobyteHD#QuobyteHD',id=0653bccb-bee9-4f73-8ac0-d9c2067c4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:21Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8a702d-616a-442d-ad59-6e141aec7dcd),volume_type_id=8b8a702d-616a-442d-ad59-6e141aec7dcd)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Creating volume 0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:05:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:05:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:21 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f 1073741824 Nov 03 12:05:21 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:22 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f 1073741824" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:22 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f Nov 03 12:05:22 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:22 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734bb8e4-6fba-4eb3-85e1-32d71fcde19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3351f81b-d3e9-4f8e-ab83-92131be007f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Volume volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f (0653bccb-bee9-4f73-8ac0-d9c2067c4d3f): created successfully Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3351f81b-d3e9-4f8e-ab83-92131be007f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (d9f1ff68-1fd7-42c0-b92d-b194f6278e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-203ad036-5ac7-47a3-80de-55cea11cba52 tempest-GroupSnapshotsTest-375493673 None] Created volume successfully. Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:24 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:05:24 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:24 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.458s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:05:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (b26aa7d8-b908-4301-a979-c87e6b9d4dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf51833-33c8-4eca-8c84-79c4f91591db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf51833-33c8-4eca-8c84-79c4f91591db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520659069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be74434-9c52-4b57-ac05-b1d17521f82f,host='devstack@QuobyteHD#QuobyteHD',id=7c028998-ecb0-4d52-88ee-13951782cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:25Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8a702d-616a-442d-ad59-6e141aec7dcd),volume_type_id=8b8a702d-616a-442d-ad59-6e141aec7dcd)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98e761-0452-4922-aefa-87490d4aa84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98e761-0452-4922-aefa-87490d4aa84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318e52f0-c805-4b99-911b-7aa8fdfa94ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318e52f0-c805-4b99-911b-7aa8fdfa94ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c028998-ecb0-4d52-88ee-13951782cb24', 'volume_name': 'volume-7c028998-ecb0-4d52-88ee-13951782cb24', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a1e68-3828-4c9d-b61d-09a62936cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a1e68-3828-4c9d-b61d-09a62936cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db2d404-710c-4ca2-81df-fb323ef8f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Volume 7c028998-ecb0-4d52-88ee-13951782cb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c028998-ecb0-4d52-88ee-13951782cb24', 'volume_size': 1} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2be74434-9c52-4b57-ac05-b1d17521f82f,created_at=2026-11-03T11:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520659069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be74434-9c52-4b57-ac05-b1d17521f82f,host='devstack@QuobyteHD#QuobyteHD',id=7c028998-ecb0-4d52-88ee-13951782cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:25Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8a702d-616a-442d-ad59-6e141aec7dcd),volume_type_id=8b8a702d-616a-442d-ad59-6e141aec7dcd)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Creating volume 7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:05:25 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:05:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:25 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 1073741824 Nov 03 12:05:25 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:26 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 1073741824" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:26 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 Nov 03 12:05:26 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:27 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24" returned: 0 in 0.734s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db2d404-710c-4ca2-81df-fb323ef8f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c028998-ecb0-4d52-88ee-13951782cb24', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda35721-3007-4501-b4e8-b8ee8a2714db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Volume volume-7c028998-ecb0-4d52-88ee-13951782cb24 (7c028998-ecb0-4d52-88ee-13951782cb24): created successfully Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda35721-3007-4501-b4e8-b8ee8a2714db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (b26aa7d8-b908-4301-a979-c87e6b9d4dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5c1dae03-ea3e-4b67-9662-3616cdf3c622 tempest-GroupSnapshotsTest-375493673 None] Created volume successfully. Nov 03 12:05:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-de008c81-5046-4d59-bd05-5820f09cb20a tempest-GroupSnapshotsTest-375493673 None] Update group completed successfully. Nov 03 12:05:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3cac5fee-2504-439b-8075-817224539af3 tempest-GroupSnapshotsTest-375493673 None] Update group completed successfully. Nov 03 12:05:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5b985646-444f-4c27-bd1b-72d127887ac7 tempest-GroupSnapshotsTest-375493673 None] Update group completed successfully. Nov 03 12:05:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dcb3edd4-c4f2-4d62-b953-83784d63b54c tempest-GroupSnapshotsTest-375493673 None] Update group completed successfully. Nov 03 12:05:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] GroupSnapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: creating. Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Group snapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Creating offline snapshot 8b657c92-f7f7-4a7f-b27e-bd6d4349e99e of volume 0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf156d-fdb1-4801-9105-64e943f9b376]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:33 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f Nov 03 12:05:33 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:34 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" returned: 0 in 0.462s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:34 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e 1G Nov 03 12:05:34 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:34 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e 1G" returned: 0 in 0.616s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:34 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e Nov 03 12:05:34 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:35 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" returned: 0 in 0.494s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:35 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:35 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e Nov 03 12:05:35 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:35 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:35 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info Nov 03 12:05:35 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:36 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:36 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:36 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info Nov 03 12:05:36 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:36 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.info" returned: 0 in 0.403s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Creating offline snapshot d00498a6-e855-488c-9c82-09d6ae05c3c3 of volume 7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcbf4cc-dbb3-43d9-a952-d1bcb2eb1355]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:36 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 Nov 03 12:05:36 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:37 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24" returned: 0 in 0.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:37 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 1G Nov 03 12:05:37 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:37 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 1G" returned: 0 in 0.512s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c028998-ecb0-4d52-88ee-13951782cb24 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:37 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c028998-ecb0-4d52-88ee-13951782cb24 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 Nov 03 12:05:37 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:37 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c028998-ecb0-4d52-88ee-13951782cb24 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:37 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 Nov 03 12:05:37 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:38 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:38 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info Nov 03 12:05:38 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:38 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info" returned: 0 in 0.267s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:38 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info Nov 03 12:05:38 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:38 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.info" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-36fbd990-0a9d-408e-9250-3c8ca533ff6e tempest-GroupSnapshotsTest-375493673 None] group_snapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: created successfully Nov 03 12:05:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] group_snapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: deleting Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] group_snapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Deleting offline snapshot 8b657c92-f7f7-4a7f-b27e-bd6d4349e99e of volume 0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] snapshot_file for this snap is: volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff25e5-4dd8-4ea6-9530-3d126c756c98]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:39 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e Nov 03 12:05:39 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:40 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" returned: 0 in 0.518s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c07cb-7591-494f-a5ab-694afeb5a020]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:40 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f Nov 03 12:05:40 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:40 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" returned: 0 in 0.394s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:40 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e Nov 03 12:05:40 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:40 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" returned: 0 in 0.383s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:40 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e Nov 03 12:05:40 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:41 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f.8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" returned: 0 in 0.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-8b657c92-f7f7-4a7f-b27e-bd6d4349e99e" released by "_delete_snapshot" :: held 1.734s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" released by "delete_snapshot" :: held 1.770s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-d00498a6-e855-488c-9c82-09d6ae05c3c3" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-d00498a6-e855-488c-9c82-09d6ae05c3c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Deleting offline snapshot d00498a6-e855-488c-9c82-09d6ae05c3c3 of volume 7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] snapshot_file for this snap is: volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[58978d60-de67-4aed-a00e-294add3ccef6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:41 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 Nov 03 12:05:41 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:41 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3" returned: 0 in 0.429s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c028998-ecb0-4d52-88ee-13951782cb24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd9a317-85e8-4dad-a4a2-f94bc3afd62d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:41 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 Nov 03 12:05:41 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:42 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24" returned: 0 in 0.439s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:42 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 Nov 03 12:05:42 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:42 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f5759c3a-a2f4-4932-9619-9c2d6fba65ca req-c83f4a12-b17d-41d0-8c9e-9c54f14abdec tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f5759c3a-a2f4-4932-9619-9c2d6fba65ca req-c83f4a12-b17d-41d0-8c9e-9c54f14abdec tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3" returned: 0 in 0.521s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f5759c3a-a2f4-4932-9619-9c2d6fba65ca req-c83f4a12-b17d-41d0-8c9e-9c54f14abdec tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:42 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3 Nov 03 12:05:42 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-f5759c3a-a2f4-4932-9619-9c2d6fba65ca req-c83f4a12-b17d-41d0-8c9e-9c54f14abdec tempest-ServerActionsTestOtherA-438295809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-52af1292-979e-400d-b8fa-112cd6ddc340', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d5f88fa-3515-4847-9c04-34747e04e92f', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:05:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f5759c3a-a2f4-4932-9619-9c2d6fba65ca req-c83f4a12-b17d-41d0-8c9e-9c54f14abdec tempest-ServerActionsTestOtherA-438295809 None] attachment_update completed successfully. Nov 03 12:05:43 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24.d00498a6-e855-488c-9c82-09d6ae05c3c3" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-d00498a6-e855-488c-9c82-09d6ae05c3c3" released by "_delete_snapshot" :: held 1.951s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" released by "delete_snapshot" :: held 1.982s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:43 devstack cinder-volume[86561]: WARNING cinder.quota [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1893027170 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1893027170, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:43 devstack cinder-volume[86561]: WARNING cinder.quota [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1893027170 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1893027170, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['f36b4edb-c544-4f49-a390-78b63041c69d', '710fa352-5cfc-40e5-ae17-e808f4f0a64c', 'ee7d665f-8bb2-4f0a-8beb-86e802d5f1a5', '24cd583d-c9de-46f7-aab5-8b5ba4ddb0cc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['978d3b73-1f5e-4e0e-bd95-1638b5be9cae', 'b765fe60-fb90-4959-adc0-e87b787a6397', '690480c1-8405-4346-a46e-82951ec640e6', 'b3b8bb37-748b-44e1-a2bd-7bb2fa746792'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-41c908c3-0974-44c9-8b92-a1fd3f44fd49 tempest-GroupSnapshotsTest-375493673 None] group_snapshot 942e28f5-6552-439f-bd8f-f4fc412f54c6: deleted successfully Nov 03 12:05:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[650717a2-1a9c-4750-b14e-898019528784]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:44 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f Nov 03 12:05:44 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:45 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" returned: 0 in 0.597s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:45 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f Nov 03 12:05:45 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:45 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-0653bccb-bee9-4f73-8ac0-d9c2067c4d3f" released by "delete_volume" :: held 1.137s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe4bf4f-75e0-4a0c-b450-7835607daed4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:46 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 Nov 03 12:05:46 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:46 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24" returned: 0 in 0.824s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:46 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24 Nov 03 12:05:46 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:46 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7c028998-ecb0-4d52-88ee-13951782cb24" returned: 0 in 0.353s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-7c028998-ecb0-4d52-88ee-13951782cb24" released by "delete_volume" :: held 1.340s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Created reservations ['bc0401a9-70a2-45c9-a560-a5e2107d656d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:47 devstack cinder-volume[86561]: WARNING cinder.quota [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1893027170 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1893027170, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Created reservations ['ffb685c7-df33-49c0-abd3-d0ad5e6b9d49', 'b8c743b8-43f0-4c1f-a102-4df104275a9c', 'b050ffed-a7dd-40b8-97d9-9081bb45e0b2', '43114cc7-b43e-46ba-82bc-6d8f3d1f396d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Created reservations ['dee491f2-cc78-4033-9bcc-dcad355028ce', '2b1e9839-f97a-472d-b3d9-57fe64a7df68', '39bbcfe6-3874-46bd-9c42-a4afcab51c24', '2c715dc8-5ba0-4545-8f65-2a1d70342d0f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:47 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:05:47 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-62316cb6-0654-4d5d-8ea7-421a736a0276 tempest-ServerActionsTestOtherA-438295809 None] Terminate volume connection completed successfully. Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-62316cb6-0654-4d5d-8ea7-421a736a0276 tempest-ServerActionsTestOtherA-438295809 None] Deleting attachment 8d5f88fa-3515-4847-9c04-34747e04e92f. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:05:47 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.471s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:05:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4b058839-6b37-4abf-ba1f-dadb854e50ec tempest-GroupSnapshotsTest-375493673 None] Delete group completed successfully. Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Flow 'volume_create_manager' (bc8d849b-5e26-477c-a608-4edbe2e6e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322c67a-31d8-40ce-9936-d5b4afc78ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322c67a-31d8-40ce-9936-d5b4afc78ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-987350666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100b3145-6510-42c3-bac3-07fb12f3beb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faf2c22f0d4b1e9d39e4fc10e6bfc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:49Z,use_quota=True,user_id='e6ef9a907da94102ab93cc367129466e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d3aea-a141-4d26-8d0f-01eb7393eb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d3aea-a141-4d26-8d0f-01eb7393eb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f069037-67fc-4556-b016-d137e0ca4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f069037-67fc-4556-b016-d137e0ca4818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100b3145-6510-42c3-bac3-07fb12f3beb9', 'volume_name': 'volume-100b3145-6510-42c3-bac3-07fb12f3beb9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58246f14-b887-4b9f-88e7-f39abea3658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58246f14-b887-4b9f-88e7-f39abea3658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a504a77-5c52-489b-bc4f-92e6f8cab1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Volume 100b3145-6510-42c3-bac3-07fb12f3beb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100b3145-6510-42c3-bac3-07fb12f3beb9', 'volume_size': 1} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-987350666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100b3145-6510-42c3-bac3-07fb12f3beb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faf2c22f0d4b1e9d39e4fc10e6bfc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:49Z,use_quota=True,user_id='e6ef9a907da94102ab93cc367129466e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Creating volume 100b3145-6510-42c3-bac3-07fb12f3beb9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:05:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-7e3c8d66-5fb6-4b52-90eb-db65ee0a30d9 tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:49 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 1073741824 Nov 03 12:05:49 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-04bb83ee-9fc7-4dbf-a536-32b2c6504a6d tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-269711883: creating Nov 03 12:05:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-04bb83ee-9fc7-4dbf-a536-32b2c6504a6d tempest-GroupSnapshotsTest-375493673 None] Group tempest-GroupSnapshotsTest-Group-269711883: created successfully Nov 03 12:05:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-04bb83ee-9fc7-4dbf-a536-32b2c6504a6d tempest-GroupSnapshotsTest-375493673 None] Create group completed successfully. Nov 03 12:05:49 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 1073741824" returned: 0 in 0.479s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:50 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 Nov 03 12:05:50 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:50 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-7e3c8d66-5fb6-4b52-90eb-db65ee0a30d9 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.758s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-7e3c8d66-5fb6-4b52-90eb-db65ee0a30d9 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a504a77-5c52-489b-bc4f-92e6f8cab1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100b3145-6510-42c3-bac3-07fb12f3beb9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a3a741-dae5-4d35-a723-997ffcb6adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Volume volume-100b3145-6510-42c3-bac3-07fb12f3beb9 (100b3145-6510-42c3-bac3-07fb12f3beb9): created successfully Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a3a741-dae5-4d35-a723-997ffcb6adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Flow 'volume_create_manager' (bc8d849b-5e26-477c-a608-4edbe2e6e03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-7e3c8d66-5fb6-4b52-90eb-db65ee0a30d9 tempest-ServerActionsTestOtherA-438295809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-52af1292-979e-400d-b8fa-112cd6ddc340', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99809389-815c-4def-87d8-72bcbeb6e17f', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:05:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7e52ae74-e269-40de-8884-2b78d977175f tempest-VolumesAdminNegativeTest-182102627 None] Created volume successfully. Nov 03 12:05:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-39addf71-e984-4a72-8f27-f7cdd737b12f req-7e3c8d66-5fb6-4b52-90eb-db65ee0a30d9 tempest-ServerActionsTestOtherA-438295809 None] attachment_update completed successfully. Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (84fea922-69a6-47a8-ab87-28cdf41556e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955e9ce7-f9e7-4e8d-b3e5-7f93269c196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955e9ce7-f9e7-4e8d-b3e5-7f93269c196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084466243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6981a720-e4b1-4c4e-b7dd-617ce7b72611,host='devstack@QuobyteHD#QuobyteHD',id=5649ee41-1a82-41f0-bc86-db4c0d183831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:51Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c8db621-80aa-44e5-b148-b1add3d5fd51),volume_type_id=8c8db621-80aa-44e5-b148-b1add3d5fd51)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6effae28-d812-45f4-8181-c8771d50f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6effae28-d812-45f4-8181-c8771d50f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037241a-9459-4725-b949-29c9b83487b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037241a-9459-4725-b949-29c9b83487b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5649ee41-1a82-41f0-bc86-db4c0d183831', 'volume_name': 'volume-5649ee41-1a82-41f0-bc86-db4c0d183831', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa940174-e2b5-49d5-b753-dcfa903dee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa940174-e2b5-49d5-b753-dcfa903dee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecb1009-a960-404e-87db-e127c12ba9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Volume 5649ee41-1a82-41f0-bc86-db4c0d183831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5649ee41-1a82-41f0-bc86-db4c0d183831', 'volume_size': 1} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6981a720-e4b1-4c4e-b7dd-617ce7b72611,created_at=2026-11-03T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084466243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6981a720-e4b1-4c4e-b7dd-617ce7b72611,host='devstack@QuobyteHD#QuobyteHD',id=5649ee41-1a82-41f0-bc86-db4c0d183831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998bee87ac3c46d287e7bbc2969acea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:51Z,use_quota=True,user_id='1df9ab41aa9c4c39b618c0fbd04ebc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c8db621-80aa-44e5-b148-b1add3d5fd51),volume_type_id=8c8db621-80aa-44e5-b148-b1add3d5fd51)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Creating volume 5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:05:51 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:51 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 1073741824 Nov 03 12:05:51 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Acquiring lock "cinder-100b3145-6510-42c3-bac3-07fb12f3beb9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "cinder-100b3145-6510-42c3-bac3-07fb12f3beb9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Acquiring lock "cinder-quobyte-100b3145-6510-42c3-bac3-07fb12f3beb9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "cinder-quobyte-100b3145-6510-42c3-bac3-07fb12f3beb9" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[42764308-1144-455f-bbee-c01a5ef8a5d6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:52 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 1073741824" returned: 0 in 0.678s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:52 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 Nov 03 12:05:52 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:52 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 Nov 03 12:05:52 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:05:53 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (fb90f31c-5c30-463d-a716-931cde4c52a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be074bf-649c-4a1d-9ea3-28d3c2a0f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831" returned: 0 in 0.715s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be074bf-649c-4a1d-9ea3-28d3c2a0f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-7989164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991b2174-1eac-432a-9699-cea378e8891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:53Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b038b30-e2fa-4fcd-aa54-1de8fb7bd6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b038b30-e2fa-4fcd-aa54-1de8fb7bd6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef4f332-135f-4861-8c1e-4ff1fb2e5331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef4f332-135f-4861-8c1e-4ff1fb2e5331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991b2174-1eac-432a-9699-cea378e8891f', 'volume_name': 'volume-991b2174-1eac-432a-9699-cea378e8891f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df106959-d5ae-4002-b3a1-ddb9a7062f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df106959-d5ae-4002-b3a1-ddb9a7062f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56167e53-a050-47ce-abef-8081d42878c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Volume 991b2174-1eac-432a-9699-cea378e8891f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991b2174-1eac-432a-9699-cea378e8891f', 'volume_size': 1} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-7989164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991b2174-1eac-432a-9699-cea378e8891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:05:53Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Creating volume 991b2174-1eac-432a-9699-cea378e8891f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:05:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:53 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecb1009-a960-404e-87db-e127c12ba9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5649ee41-1a82-41f0-bc86-db4c0d183831', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f890539-1369-40a9-90b3-cf83d45e4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9" returned: 0 in 1.282s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:53 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f 1073741824 Nov 03 12:05:53 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Volume volume-5649ee41-1a82-41f0-bc86-db4c0d183831 (5649ee41-1a82-41f0-bc86-db4c0d183831): created successfully Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f890539-1369-40a9-90b3-cf83d45e4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:53 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9 Nov 03 12:05:53 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Flow 'volume_create_manager' (84fea922-69a6-47a8-ab87-28cdf41556e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-12a8b30f-719c-4892-9ba0-3262141ba488 tempest-GroupSnapshotsTest-375493673 None] Created volume successfully. Nov 03 12:05:53 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-100b3145-6510-42c3-bac3-07fb12f3beb9" returned: 0 in 0.595s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "cinder-quobyte-100b3145-6510-42c3-bac3-07fb12f3beb9" released by "delete_volume" :: held 1.942s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Created reservations ['4e55949d-c999-4aec-8393-83200cab7357', '9205b108-c79e-47c1-a7f8-dc92ea6c2134', 'a73805db-e0f5-42b4-8d1f-3c509d4329ea', 'd7111d2a-38ac-4df9-bd2d-46499f038e1b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:54 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f 1073741824" returned: 0 in 1.017s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:54 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:05:54 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:54 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f Nov 03 12:05:54 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:54 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.420s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:05:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Deleted volume successfully. Nov 03 12:05:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47bc14e8-2a33-4f14-9d07-e2938cb69995 tempest-VolumesAdminNegativeTest-182102627 None] Lock "cinder-100b3145-6510-42c3-bac3-07fb12f3beb9-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:05:54 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f" returned: 0 in 0.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56167e53-a050-47ce-abef-8081d42878c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991b2174-1eac-432a-9699-cea378e8891f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0864fd-a692-4cf2-bbf7-2df1f038201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:05:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Volume volume-991b2174-1eac-432a-9699-cea378e8891f (991b2174-1eac-432a-9699-cea378e8891f): created successfully Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0864fd-a692-4cf2-bbf7-2df1f038201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (fb90f31c-5c30-463d-a716-931cde4c52a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:05:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2b546181-16af-4235-aae6-7405ed1e06d8 tempest-AttachVolumeTestJSON-169687713 None] Created volume successfully. Nov 03 12:05:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] GroupSnapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: creating. Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Group snapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Creating offline snapshot 43163043-91b2-4d79-99b4-c5cee947d7bd of volume 5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66fd04f-79ce-419b-9b05-0494f21c15f4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:55 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 Nov 03 12:05:55 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:56 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831" returned: 0 in 0.976s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:56 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd 1G Nov 03 12:05:56 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:57 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd 1G" returned: 0 in 0.800s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649ee41-1a82-41f0-bc86-db4c0d183831 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:57 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649ee41-1a82-41f0-bc86-db4c0d183831 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd Nov 03 12:05:57 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6b02e97f-6248-4bad-84b6-b736d75606ed req-3ca0086d-c109-4e4e-a664-857f563d0c85 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:05:57 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649ee41-1a82-41f0-bc86-db4c0d183831 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:57 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:57 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd Nov 03 12:05:57 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:57 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:58 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info Nov 03 12:05:58 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:58 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:58 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:58 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info Nov 03 12:05:58 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:05:58 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.info" returned: 0 in 0.272s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6b02e97f-6248-4bad-84b6-b736d75606ed req-3ca0086d-c109-4e4e-a664-857f563d0c85 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.041s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6b02e97f-6248-4bad-84b6-b736d75606ed req-3ca0086d-c109-4e4e-a664-857f563d0c85 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:05:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-6b02e97f-6248-4bad-84b6-b736d75606ed req-3ca0086d-c109-4e4e-a664-857f563d0c85 tempest-AttachVolumeTestJSON-169687713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-991b2174-1eac-432a-9699-cea378e8891f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46303fbb-3cbe-4010-a724-dc5162a4d565', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:05:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6a6f13f-adb3-40fb-9eb9-711e0dd90055 tempest-GroupSnapshotsTest-375493673 None] group_snapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: created successfully Nov 03 12:05:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-6b02e97f-6248-4bad-84b6-b736d75606ed req-3ca0086d-c109-4e4e-a664-857f563d0c85 tempest-AttachVolumeTestJSON-169687713 None] attachment_update completed successfully. Nov 03 12:05:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] group_snapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: deleting Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] group_snapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-43163043-91b2-4d79-99b4-c5cee947d7bd" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-43163043-91b2-4d79-99b4-c5cee947d7bd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Deleting offline snapshot 43163043-91b2-4d79-99b4-c5cee947d7bd of volume 5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] snapshot_file for this snap is: volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe88e2-3360-408d-8bce-ef2dc8cd214d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:05:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:05:59 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd Nov 03 12:05:59 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:00 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd" returned: 0 in 0.399s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5649ee41-1a82-41f0-bc86-db4c0d183831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d80ddb-2955-452b-977c-20361825872c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:00 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 Nov 03 12:06:00 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:00 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831" returned: 0 in 0.505s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:00 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd Nov 03 12:06:00 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:01 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd" returned: 0 in 0.518s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:01 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd Nov 03 12:06:01 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:01 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831.43163043-91b2-4d79-99b4-c5cee947d7bd" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-43163043-91b2-4d79-99b4-c5cee947d7bd" released by "_delete_snapshot" :: held 1.857s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" released by "delete_snapshot" :: held 1.899s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:01 devstack cinder-volume[86561]: WARNING cinder.quota [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-393759768 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-393759768, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:01 devstack cinder-volume[86561]: WARNING cinder.quota [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-393759768 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-393759768, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:01 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['f5a538f7-7922-40e9-95bb-dc14956db2ba', '4d957cb6-d047-43f8-a2b7-d518a7e24e2c', '912d6364-f782-4c7c-8135-ddb2e28c0813', 'c195a662-229b-44e1-ac77-c1a275626a0c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-06616344-3904-46d9-8683-ca7958cc4361 tempest-GroupSnapshotsTest-375493673 None] group_snapshot ce01b821-7ade-4d97-9ac4-aaeb39c032f5: deleted successfully Nov 03 12:06:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:06:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:06:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf54d3fe-cfa4-49cb-9a7c-9d8e9cfcc55e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:02 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 Nov 03 12:06:02 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:03 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:03 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831 Nov 03 12:06:03 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:03 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5649ee41-1a82-41f0-bc86-db4c0d183831" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Lock "cinder-quobyte-5649ee41-1a82-41f0-bc86-db4c0d183831" released by "delete_volume" :: held 1.231s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['5dab9e51-d21d-422b-81e5-b039d594f977'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:03 devstack cinder-volume[86561]: WARNING cinder.quota [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-393759768 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-393759768, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Created reservations ['4c934221-cdc4-4961-a510-4703d6f367fd', '8aeebbb9-132e-4513-b407-99e01412750f', 'e51aec88-c4cb-42d9-a3e1-08f28060f718', 'd041f720-ee97-49f1-8b8b-4e9484ef445b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:04 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:06:04 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:04 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:06:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-23702cd6-b7ff-45f7-979a-a2a0ddce8c03 tempest-GroupSnapshotsTest-375493673 None] Delete group completed successfully. Nov 03 12:06:13 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=126,cinder:UPDATE=115,cinder:INSERT=27,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:06:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce4e9c28-def9-4234-a234-39645d534838 tempest-GroupsTest-2071182144 None] Group tempest-Group1-1289807148: creating Nov 03 12:06:13 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:INSERT=26,cinder:UPDATE=119,cinder:SELECT=131,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:06:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce4e9c28-def9-4234-a234-39645d534838 tempest-GroupsTest-2071182144 None] Group tempest-Group1-1289807148: created successfully Nov 03 12:06:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce4e9c28-def9-4234-a234-39645d534838 tempest-GroupsTest-2071182144 None] Create group completed successfully. Nov 03 12:06:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8928bea4-8b3f-4a51-a57e-9966674d1173 tempest-GroupsTest-2071182144 None] Group tempest-Group2-1329852930: creating Nov 03 12:06:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8928bea4-8b3f-4a51-a57e-9966674d1173 tempest-GroupsTest-2071182144 None] Group tempest-Group2-1329852930: created successfully Nov 03 12:06:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8928bea4-8b3f-4a51-a57e-9966674d1173 tempest-GroupsTest-2071182144 None] Create group completed successfully. Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (c8ec1b1a-6ab7-495c-a0aa-6ea501604d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a06e43-ce19-4b0c-9c91-ab0677140dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a06e43-ce19-4b0c-9c91-ab0677140dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774725264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff61d896-3626-49ed-a139-e5f67aacf20e,host='devstack@QuobyteHD#QuobyteHD',id=e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:16Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e8383-17d9-4809-9611-279eaac5b859),volume_type_id=dc0e8383-17d9-4809-9611-279eaac5b859)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d01c561-d701-4477-8f72-6f93a787814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d01c561-d701-4477-8f72-6f93a787814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b13d43-3563-4180-9632-ea5c60aaddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b13d43-3563-4180-9632-ea5c60aaddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7', 'volume_name': 'volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786854d9-805f-475a-8161-03333afdeea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786854d9-805f-475a-8161-03333afdeea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa9c5cb-06cc-4934-b051-e1c1c1569462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Volume e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7', 'volume_size': 1} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff61d896-3626-49ed-a139-e5f67aacf20e,created_at=2026-11-03T11:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774725264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff61d896-3626-49ed-a139-e5f67aacf20e,host='devstack@QuobyteHD#QuobyteHD',id=e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:16Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e8383-17d9-4809-9611-279eaac5b859),volume_type_id=dc0e8383-17d9-4809-9611-279eaac5b859)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Creating volume e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:06:16 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:06:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:16 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 1073741824 Nov 03 12:06:16 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:17 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 1073741824" returned: 0 in 0.609s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:17 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 Nov 03 12:06:17 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:17 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" returned: 0 in 0.385s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa9c5cb-06cc-4934-b051-e1c1c1569462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2513a72-bdcb-48d4-987d-b84221852954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Volume volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 (e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7): created successfully Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2513a72-bdcb-48d4-987d-b84221852954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (c8ec1b1a-6ab7-495c-a0aa-6ea501604d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-45e53ff1-d04f-4d7d-b759-30df1a0d51bb tempest-GroupsTest-2071182144 None] Created volume successfully. Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Acquiring lock "cinder-quobyte-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de65a604-7949-4da8-aafe-6c9cc36898b7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:20 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 Nov 03 12:06:20 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:20 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" returned: 0 in 0.589s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:21 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7 Nov 03 12:06:21 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:21 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-e9b2873b-0c5f-43bf-a5ad-9bd3ebf43ce7" released by "delete_volume" :: held 1.015s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Created reservations ['821afc6e-517e-4462-ab67-c20ff257279e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-909974522 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-909974522, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-909974522 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-909974522, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Created reservations ['770e2d59-bb8f-4ff5-b04e-37e5a1f69df8', 'cffad85a-f127-4b7c-b881-7bdcafed93cd', 'ea844608-0b25-4f0f-9545-b3d1f4a6ac34', '0f651ef2-4b68-4021-a8fc-a88279a1d724'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-a48fc09b-af56-4cd5-85e0-0bc8109db440 req-d098cc36-b483-4da7-ac49-ec32579bc2fe tempest-ServerActionsTestOtherA-438295809 None] Terminate volume connection completed successfully. Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-a48fc09b-af56-4cd5-85e0-0bc8109db440 req-d098cc36-b483-4da7-ac49-ec32579bc2fe tempest-ServerActionsTestOtherA-438295809 None] Deleting attachment 99809389-815c-4def-87d8-72bcbeb6e17f. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:21 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:06:21 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:21 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:06:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c595b12a-9e6f-4af4-9b7e-e78414ff3d70 tempest-GroupsTest-2071182144 None] Delete group completed successfully. Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Created reservations ['b448203b-d1a8-4150-a4ca-381814316fbd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:23 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:06:23 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:23 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:06:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a1180010-22fc-4b1b-96c9-3bc8251427a2 tempest-GroupsTest-2071182144 None] Delete group completed successfully. Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:24 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:06:24 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:24 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.437s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:06:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2d6e5e04-836f-4323-bd6b-1d0d174d95ba tempest-GroupsTest-2071182144 None] Group tempest-GroupsTest-Group-72885944: creating Nov 03 12:06:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2d6e5e04-836f-4323-bd6b-1d0d174d95ba tempest-GroupsTest-2071182144 None] Group tempest-GroupsTest-Group-72885944: created successfully Nov 03 12:06:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2d6e5e04-836f-4323-bd6b-1d0d174d95ba tempest-GroupsTest-2071182144 None] Create group completed successfully. Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (4112ec4e-aaa4-449c-8355-2f540dc8c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3251a-f6d6-4d89-9092-14f984b9892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3251a-f6d6-4d89-9092-14f984b9892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480343704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,host='devstack@QuobyteHD#QuobyteHD',id=499d3679-d954-4c2c-9ae8-ed13f8044d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:26Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a490af-ead4-481a-91e4-4e2ad293c559),volume_type_id=76a490af-ead4-481a-91e4-4e2ad293c559)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37843d88-abb5-4539-89e4-79ee94a61dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37843d88-abb5-4539-89e4-79ee94a61dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bbf52d-a63f-4995-b4f3-4cfac1e8618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bbf52d-a63f-4995-b4f3-4cfac1e8618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499d3679-d954-4c2c-9ae8-ed13f8044d9d', 'volume_name': 'volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071c2d59-6012-4d8f-9f04-1045f87960d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071c2d59-6012-4d8f-9f04-1045f87960d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f5affb-2942-4be8-9b77-0d8116b1887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Volume 499d3679-d954-4c2c-9ae8-ed13f8044d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d', 'volume_size': 1} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,created_at=2026-11-03T11:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480343704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,host='devstack@QuobyteHD#QuobyteHD',id=499d3679-d954-4c2c-9ae8-ed13f8044d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:26Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a490af-ead4-481a-91e4-4e2ad293c559),volume_type_id=76a490af-ead4-481a-91e4-4e2ad293c559)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Creating volume 499d3679-d954-4c2c-9ae8-ed13f8044d9d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:06:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:06:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:26 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d 1073741824 Nov 03 12:06:26 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:27 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d 1073741824" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:27 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d Nov 03 12:06:27 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:27 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d" returned: 0 in 0.315s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f5affb-2942-4be8-9b77-0d8116b1887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781d68d6-8c1a-4cfb-adc3-885ae540c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Volume volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d (499d3679-d954-4c2c-9ae8-ed13f8044d9d): created successfully Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781d68d6-8c1a-4cfb-adc3-885ae540c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (4112ec4e-aaa4-449c-8355-2f540dc8c890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6bd6d337-eb23-414d-aacc-7b5ddd149ff5 tempest-GroupsTest-2071182144 None] Created volume successfully. Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Flow 'volume_create_manager' (c16f1a00-2fef-40c6-8570-5fbc56ec49b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fff9081-b4a0-4b6c-b5ce-cc0ec08f9346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fff9081-b4a0-4b6c-b5ce-cc0ec08f9346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1684266095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbf93ee-557f-4a47-8ef6-72e68131eaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c240a59d151b46abae43caa25d25144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:28Z,use_quota=True,user_id='c341f71cfb99463e8d386d898b7490a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0efacac-4a60-4dcd-a44c-ed8c08adcce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0efacac-4a60-4dcd-a44c-ed8c08adcce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6d1e47-d693-4362-82e9-a502b5b01130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (ae7e2f26-cb25-4c28-ae79-1edb6cfc0993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6885ad4a-6f46-4017-b3c7-ce7dc61693e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6885ad4a-6f46-4017-b3c7-ce7dc61693e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1997417893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,host='devstack@QuobyteHD#QuobyteHD',id=225379a0-4339-4801-b288-722cd7db8b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:28Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a490af-ead4-481a-91e4-4e2ad293c559),volume_type_id=76a490af-ead4-481a-91e4-4e2ad293c559)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e88bf-b8f5-4d92-afc7-476358847d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e88bf-b8f5-4d92-afc7-476358847d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41aab3a4-f3f7-4315-8a59-cbce7d51af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41aab3a4-f3f7-4315-8a59-cbce7d51af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225379a0-4339-4801-b288-722cd7db8b26', 'volume_name': 'volume-225379a0-4339-4801-b288-722cd7db8b26', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e95b87-19ed-43e8-8434-5ffae62ae1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e95b87-19ed-43e8-8434-5ffae62ae1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447171ed-24ce-4718-bcf8-dabe3f5007ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Volume 225379a0-4339-4801-b288-722cd7db8b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225379a0-4339-4801-b288-722cd7db8b26', 'volume_size': 1} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,created_at=2026-11-03T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1997417893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f67355d0-59be-45ea-ac25-ac0949bb0f03,host='devstack@QuobyteHD#QuobyteHD',id=225379a0-4339-4801-b288-722cd7db8b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5218c118cfde429ebcb75d0b6f9622d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:28Z,use_quota=True,user_id='3d9ab5d82d834844a34114061f700594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a490af-ead4-481a-91e4-4e2ad293c559),volume_type_id=76a490af-ead4-481a-91e4-4e2ad293c559)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Creating volume 225379a0-4339-4801-b288-722cd7db8b26 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:06:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:06:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:28 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 1073741824 Nov 03 12:06:28 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6d1e47-d693-4362-82e9-a502b5b01130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'volume_name': 'volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2182da84-93b7-4bee-99bb-65c3a9eec2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2182da84-93b7-4bee-99bb-65c3a9eec2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc5923a-89ab-441e-8e55-5b9f83bc7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Trying to clone ffbf93ee-557f-4a47-8ef6-72e68131eaf5 from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:06:29 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 1073741824" returned: 0 in 0.697s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:29 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 Nov 03 12:06:29 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:06:29 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c6c00-1062-4564-8d6b-cf29eba38e29]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:30 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26" returned: 0 in 0.601s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:30 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD Nov 03 12:06:30 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447171ed-24ce-4718-bcf8-dabe3f5007ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225379a0-4339-4801-b288-722cd7db8b26', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2660dfaa-13a0-4b18-9fe5-cbe72e5c64ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Volume volume-225379a0-4339-4801-b288-722cd7db8b26 (225379a0-4339-4801-b288-722cd7db8b26): created successfully Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2660dfaa-13a0-4b18-9fe5-cbe72e5c64ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Flow 'volume_create_manager' (ae7e2f26-cb25-4c28-ae79-1edb6cfc0993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2ac6ea88-df90-495e-bd24-de85fe4a0af0 tempest-GroupsTest-2071182144 None] Created volume successfully. Nov 03 12:06:30 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 is fetched for user c341f71cfb99463e8d386d898b7490a1. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c8009-9cc0-499c-a385-3c6c85d2ef75]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:30 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD Nov 03 12:06:30 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:31 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1684266095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbf93ee-557f-4a47-8ef6-72e68131eaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c240a59d151b46abae43caa25d25144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:28Z,use_quota=True,user_id='c341f71cfb99463e8d386d898b7490a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Creating volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:06:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:31 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1073741824 Nov 03 12:06:31 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-d71ea487-22b2-4fca-ba1b-bf5150550675 req-3410657e-d2f1-4b44-865e-17ad44fb2265 tempest-AttachVolumeTestJSON-169687713 None] Terminate volume connection completed successfully. Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-d71ea487-22b2-4fca-ba1b-bf5150550675 req-3410657e-d2f1-4b44-865e-17ad44fb2265 tempest-AttachVolumeTestJSON-169687713 None] Deleting attachment 46303fbb-3cbe-4010-a724-dc5162a4d565. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:06:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6f0a84e9-cce2-486c-a8cc-638ec1ea9165 tempest-GroupsTest-2071182144 None] Update group completed successfully. Nov 03 12:06:31 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1073741824" returned: 0 in 0.689s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:31 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 Nov 03 12:06:31 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:32 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" returned: 0 in 0.347s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Attempting download of c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2a86d-d6dd-4105-a72d-d28b1fca4275]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:32 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua Nov 03 12:06:32 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:32 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua" returned: 0 in 0.499s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:33 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua Nov 03 12:06:33 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f45698a5-63cf-444e-bee0-ed69472970f7 tempest-GroupsTest-2071182144 None] Update group completed successfully. Nov 03 12:06:33 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua" returned: 1 in 0.441s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_xa74m7ua' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da45922-ba3d-49ca-a248-1fa14e7375eb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:33 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD Nov 03 12:06:33 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:33 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:06:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:33 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 Nov 03 12:06:33 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Acquiring lock "cinder-quobyte-225379a0-4339-4801-b288-722cd7db8b26" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-225379a0-4339-4801-b288-722cd7db8b26" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe508b-e1bf-4180-b1ed-92c4b4a092fe]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:35 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 Nov 03 12:06:35 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:35 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26" returned: 0 in 0.659s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:35 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26 Nov 03 12:06:35 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:36 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-225379a0-4339-4801-b288-722cd7db8b26" returned: 0 in 0.431s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-225379a0-4339-4801-b288-722cd7db8b26" released by "delete_volume" :: held 1.176s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Acquiring lock "cinder-quobyte-499d3679-d954-4c2c-9ae8-ed13f8044d9d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-499d3679-d954-4c2c-9ae8-ed13f8044d9d" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7173cb-c9ef-4c7e-964f-696404d56749]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:36 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d Nov 03 12:06:36 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:36 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" returned: 0 in 3.027s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_f9t7yp9xdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:06:36 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Converted 112.00 MB image at 36.98 MB/s Nov 03 12:06:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:36 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1G Nov 03 12:06:36 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:37 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d" returned: 0 in 0.774s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:37 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d Nov 03 12:06:37 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:37 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 1G" returned: 0 in 0.663s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Downloaded image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 for user c341f71cfb99463e8d386d898b7490a1 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Marking volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Copying metadata from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 to ffbf93ee-557f-4a47-8ef6-72e68131eaf5. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Creating volume glance metadata for volume ffbf93ee-557f-4a47-8ef6-72e68131eaf5 backed by image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc5923a-89ab-441e-8e55-5b9f83bc7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d084aa1-bd60-4723-aa85-554b2c04bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Volume volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 (ffbf93ee-557f-4a47-8ef6-72e68131eaf5): created successfully Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d084aa1-bd60-4723-aa85-554b2c04bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Flow 'volume_create_manager' (c16f1a00-2fef-40c6-8570-5fbc56ec49b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6297b956-0732-479d-877f-cb3be2ec092b tempest-ServerActionsTestOtherA-438295809 None] Created volume successfully. Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-499d3679-d954-4c2c-9ae8-ed13f8044d9d" returned: 0 in 0.698s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:37 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "cinder-quobyte-499d3679-d954-4c2c-9ae8-ed13f8044d9d" released by "delete_volume" :: held 1.579s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Created reservations ['09de05e4-694e-4f78-a6f5-95acb7d65440'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:38 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-674468281 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-674468281, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:38 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-674468281 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-674468281, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Created reservations ['14479b78-96c8-4447-9f97-a4c2e70162cc', 'cbc88244-0a0c-4a8f-949c-7d80b0df7531', '02dd2100-9a8e-4a9d-bdc4-fdc9d997f613', 'af967f3a-ab6d-4fc1-8fe9-3797dcb4a4cb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Created reservations ['303c309c-5190-4fca-be70-48196774e389', 'c050b88f-e56a-4005-b0c8-ad289f7d0ff9', '99535d0e-1f44-4183-96f1-5cb6e23a9e76', 'dd46fd11-46c6-4aa2-a205-f376d0cdbe40'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:38 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:06:38 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:38 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.346s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:06:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a148e683-9e2d-4650-9bcf-f11bc8561254 tempest-GroupsTest-2071182144 None] Delete group completed successfully. Nov 03 12:06:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9ad8fa79-0c2e-4d97-8b1b-6500aa05706e req-55fee544-25e0-4e6b-894a-89885a9c6580 tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9ad8fa79-0c2e-4d97-8b1b-6500aa05706e req-55fee544-25e0-4e6b-894a-89885a9c6580 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9ad8fa79-0c2e-4d97-8b1b-6500aa05706e req-55fee544-25e0-4e6b-894a-89885a9c6580 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-9ad8fa79-0c2e-4d97-8b1b-6500aa05706e req-55fee544-25e0-4e6b-894a-89885a9c6580 tempest-ServerActionsTestOtherA-438295809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58a20a79-fa3a-4417-9160-2f18e38f480b', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:06:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-9ad8fa79-0c2e-4d97-8b1b-6500aa05706e req-55fee544-25e0-4e6b-894a-89885a9c6580 tempest-ServerActionsTestOtherA-438295809 None] attachment_update completed successfully. Nov 03 12:06:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-07651ca0-5c0f-4326-9dca-b7132e303c30 tempest-GroupsV314Test-130799225 None] Group tempest-GroupsV314Test-Group-1590493868: creating Nov 03 12:06:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-07651ca0-5c0f-4326-9dca-b7132e303c30 tempest-GroupsV314Test-130799225 None] Group tempest-GroupsV314Test-Group-1590493868: created successfully Nov 03 12:06:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-07651ca0-5c0f-4326-9dca-b7132e303c30 tempest-GroupsV314Test-130799225 None] Create group completed successfully. Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Flow 'volume_create_manager' (ba198a24-73e9-4d21-907d-1ef199335a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ff9321-2b98-4b35-a0e0-d105b042f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ff9321-2b98-4b35-a0e0-d105b042f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470242463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c406e7e-6974-4d90-9414-5eeae9cddde6,host='devstack@QuobyteHD#QuobyteHD',id=6dc3625f-595f-4da8-927b-298c8ff9f496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3394283c50284ef8a4f3e319166bf55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:52Z,use_quota=True,user_id='9817754dc0d049f78a6179bb52a3734d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5411b039-6d76-4637-a11d-d677edf946e3),volume_type_id=5411b039-6d76-4637-a11d-d677edf946e3)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c76aea-27b2-4e6d-bd78-b733a02de486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c76aea-27b2-4e6d-bd78-b733a02de486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d023127-1d7c-42b7-acd1-42ac3fe12b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d023127-1d7c-42b7-acd1-42ac3fe12b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc3625f-595f-4da8-927b-298c8ff9f496', 'volume_name': 'volume-6dc3625f-595f-4da8-927b-298c8ff9f496', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989a3c36-1022-4d7c-b0a0-50b5d3f5ff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989a3c36-1022-4d7c-b0a0-50b5d3f5ff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5887c6e-ef91-4b25-a599-b961f2a1905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Volume 6dc3625f-595f-4da8-927b-298c8ff9f496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc3625f-595f-4da8-927b-298c8ff9f496', 'volume_size': 1} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c406e7e-6974-4d90-9414-5eeae9cddde6,created_at=2026-11-03T11:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470242463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c406e7e-6974-4d90-9414-5eeae9cddde6,host='devstack@QuobyteHD#QuobyteHD',id=6dc3625f-595f-4da8-927b-298c8ff9f496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3394283c50284ef8a4f3e319166bf55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:52Z,use_quota=True,user_id='9817754dc0d049f78a6179bb52a3734d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5411b039-6d76-4637-a11d-d677edf946e3),volume_type_id=5411b039-6d76-4637-a11d-d677edf946e3)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Creating volume 6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:06:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:06:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:52 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 1073741824 Nov 03 12:06:52 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:53 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 1073741824" returned: 0 in 0.642s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:53 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:06:53 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:53 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.490s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5887c6e-ef91-4b25-a599-b961f2a1905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc3625f-595f-4da8-927b-298c8ff9f496', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c366007-ef21-4914-a0c5-954a93d29c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Volume volume-6dc3625f-595f-4da8-927b-298c8ff9f496 (6dc3625f-595f-4da8-927b-298c8ff9f496): created successfully Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c366007-ef21-4914-a0c5-954a93d29c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Flow 'volume_create_manager' (ba198a24-73e9-4d21-907d-1ef199335a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4dde7ee7-ec5b-4621-b37f-9a09dea6863c tempest-GroupsV314Test-130799225 None] Created volume successfully. Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Cloning volume 6dc3625f-595f-4da8-927b-298c8ff9f496 to volume 6d3607dd-42ba-4b50-baff-e7055b921237 Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Creating offline snapshot 576fb32c-88f4-4f48-920c-a141763ca3cd of volume 6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8411e903-1c0d-4bd5-bdc9-ad27fb701112]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:56 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:06:56 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:56 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:57 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd 1G Nov 03 12:06:57 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Flow 'volume_create_manager' (70426597-ec8d-4b39-93b0-8790b05d8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850f66fa-6798-4c62-80af-477d2f7f854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850f66fa-6798-4c62-80af-477d2f7f854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-317624997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ca468-abf2-4cf4-8427-b78fdcf5c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fea8ffba2441cebbaed5c8327b0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:57Z,use_quota=True,user_id='66c02d752e3247b280a1c43ae4c59463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e97fb-b7c4-44db-b203-ce8589cf11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e97fb-b7c4-44db-b203-ce8589cf11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e4e5b-f8d2-4195-881b-8ba5bc3e85a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e4e5b-f8d2-4195-881b-8ba5bc3e85a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14ca468-abf2-4cf4-8427-b78fdcf5c9f9', 'volume_name': 'volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f878f32-0e28-4bcb-92e8-8b237a6cbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f878f32-0e28-4bcb-92e8-8b237a6cbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57ac442-116f-4655-9a5a-283edf4a2a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:06:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Volume f14ca468-abf2-4cf4-8427-b78fdcf5c9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9', 'volume_size': 1} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:57 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd 1G" returned: 0 in 0.541s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3625f-595f-4da8-927b-298c8ff9f496 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:57 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3625f-595f-4da8-927b-298c8ff9f496 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:06:57 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:57 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3625f-595f-4da8-927b-298c8ff9f496 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.303s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:57 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:06:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:57 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:06:57 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:58 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.415s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:58 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info Nov 03 12:06:58 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:58 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info" returned: 0 in 0.284s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:58 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:58 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info Nov 03 12:06:58 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:58 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.info" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Acquiring lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] snapshot: 576fb32c-88f4-4f48-920c-a141763ca3cd, volume: 6d3607dd-42ba-4b50-baff-e7055b921237, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceeb29a-34e2-4609-8f66-68da9523b3bf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:59 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:06:59 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:06:59 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Nov 03 12:06:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.544s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:06:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc3625f-595f-4da8-927b-298c8ff9f496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:06:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9717fc43-f8c8-407d-b433-a9b2fc4d3197]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:06:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:06:59 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:06:59 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-840f1c21-4e82-4b66-9122-a1329508087d req-3a07794a-7957-4acf-900b-9ea0e604da24 tempest-ServerActionsTestOtherA-438295809 None] Terminate volume connection completed successfully. Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-840f1c21-4e82-4b66-9122-a1329508087d req-3a07794a-7957-4acf-900b-9ea0e604da24 tempest-ServerActionsTestOtherA-438295809 None] Deleting attachment 58a20a79-fa3a-4417-9160-2f18e38f480b. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:07:00 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:07:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:00 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 Nov 03 12:07:00 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-840f1c21-4e82-4b66-9122-a1329508087d req-9d80ee90-6953-443a-956d-23b453d735da tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:07 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237" returned: 0 in 7.355s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:07:07 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Converted 1024.00 MB image at 139.21 MB/s Nov 03 12:07:07 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:07 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 Nov 03 12:07:07 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:07 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" released by "_copy_volume_from_snapshot" :: held 8.963s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Acquiring lock "cinder-quobyte-576fb32c-88f4-4f48-920c-a141763ca3cd" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-576fb32c-88f4-4f48-920c-a141763ca3cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Deleting offline snapshot 576fb32c-88f4-4f48-920c-a141763ca3cd of volume 6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] snapshot_file for this snap is: volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253929a-b99f-4909-b875-aad7c25fcd01]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:08 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:07:08 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:08 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.368s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc3625f-595f-4da8-927b-298c8ff9f496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5959dc36-5302-4eb3-9ee6-ad8a94c52479]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:08 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:07:08 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:08 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.487s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:08 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:07:08 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:09 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.328s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:09 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd Nov 03 12:07:09 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:09 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496.576fb32c-88f4-4f48-920c-a141763ca3cd" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-576fb32c-88f4-4f48-920c-a141763ca3cd" released by "_delete_snapshot" :: held 1.523s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.297s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.024s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-317624997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ca468-abf2-4cf4-8427-b78fdcf5c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fea8ffba2441cebbaed5c8327b0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:06:57Z,use_quota=True,user_id='66c02d752e3247b280a1c43ae4c59463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Creating volume f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:07:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:09 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 1073741824 Nov 03 12:07:09 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5b5496f0-e93e-403a-86c6-d23ba3d64a47 tempest-GroupsV314Test-130799225 None] Create group from source-group-3c406e7e-6974-4d90-9414-5eeae9cddde6 completed successfully. Nov 03 12:07:09 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 1073741824" returned: 0 in 0.393s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:09 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 Nov 03 12:07:09 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:10 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-840f1c21-4e82-4b66-9122-a1329508087d req-9d80ee90-6953-443a-956d-23b453d735da tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.650s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57ac442-116f-4655-9a5a-283edf4a2a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2681d243-c892-48b0-af2a-6e68e5e05f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-840f1c21-4e82-4b66-9122-a1329508087d req-9d80ee90-6953-443a-956d-23b453d735da tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Volume volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 (f14ca468-abf2-4cf4-8427-b78fdcf5c9f9): created successfully Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2681d243-c892-48b0-af2a-6e68e5e05f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Flow 'volume_create_manager' (70426597-ec8d-4b39-93b0-8790b05d8e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d51e86a5-5a40-46ec-8dc4-8f596cf2cfe6 tempest-TaggedAttachmentsTest-1666946828 None] Created volume successfully. Nov 03 12:07:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-840f1c21-4e82-4b66-9122-a1329508087d req-9d80ee90-6953-443a-956d-23b453d735da tempest-ServerActionsTestOtherA-438295809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '326ce5f0-6ea4-493a-bda2-460b28bc729e', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:07:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-840f1c21-4e82-4b66-9122-a1329508087d req-9d80ee90-6953-443a-956d-23b453d735da tempest-ServerActionsTestOtherA-438295809 None] attachment_update completed successfully. Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Acquiring lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c562bd7-171e-4cc3-abac-5650508fc090]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:11 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 Nov 03 12:07:11 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:11 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237" returned: 0 in 0.583s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:11 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237 Nov 03 12:07:11 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:12 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d3607dd-42ba-4b50-baff-e7055b921237" returned: 0 in 0.335s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6d3607dd-42ba-4b50-baff-e7055b921237" released by "delete_volume" :: held 0.998s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Created reservations ['d6f3cc29-a36c-4d99-bee6-2b234c097f97'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:12 devstack cinder-volume[86561]: WARNING cinder.quota [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-405721271 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-405721271, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:07:12 devstack cinder-volume[86561]: WARNING cinder.quota [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-405721271 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-405721271, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Created reservations ['6da65e95-36b3-4ed3-9c04-9fb22553d2ef', '798dc50d-b77b-40fc-9925-e5468f6cc048', '5411d79c-c9c0-4201-b0ca-6938116ead03', '23034e36-398c-44d2-b355-7bc948730eba'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:12 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:12 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:12 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ac87967c-08b4-4524-9a48-a54e3a1fae31 tempest-GroupsV314Test-130799225 None] Delete group completed successfully. Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Acquiring lock "cinder-quobyte-6dc3625f-595f-4da8-927b-298c8ff9f496" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6dc3625f-595f-4da8-927b-298c8ff9f496" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b2b0b-7321-42a3-9737-d2e4436c4faf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:13 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:07:13 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:13 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.446s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:13 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496 Nov 03 12:07:13 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:13 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6dc3625f-595f-4da8-927b-298c8ff9f496" returned: 0 in 0.266s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Lock "cinder-quobyte-6dc3625f-595f-4da8-927b-298c8ff9f496" released by "delete_volume" :: held 0.885s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=88,cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=79,cinder:SELECT=87,cinder:INSERT=24,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Created reservations ['faeec29e-88e1-4077-aa1f-18b6dbb6805e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Created reservations ['d13a782f-df8d-4291-85e1-68d006134804', '18058352-cb5d-4a72-9f00-206e79eab5ac', 'f252d08f-0e34-4b5b-9abd-309bba471b96', 'a4997be8-b5c5-484a-881c-97023fe22f7a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:14 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:14 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:14 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.443s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:14 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2cb2b93c-bcd4-44e4-9c00-1cce86bbebfc tempest-GroupsV314Test-130799225 None] Delete group completed successfully. Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=12,cinder:SELECT=9,cinder:INSERT=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:24 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:24 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:24 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.500s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:07:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Flow 'volume_create_manager' (06bf6d63-7d93-46be-bfe3-f4d2eb4a344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6d99c1-271e-49d7-a540-d96a9d999fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6d99c1-271e-49d7-a540-d96a9d999fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1710589704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c9ae13-d3d9-4f62-8949-24f7388353cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5963aa628042e4a04bdc72c02cfb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:28Z,use_quota=True,user_id='56ad29d02d7a439bae0a2c6a01d2ef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a69a41-658e-4e76-8704-f9936afd0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a69a41-658e-4e76-8704-f9936afd0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123ae2e0-3596-41bb-96e8-6f2941cc171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123ae2e0-3596-41bb-96e8-6f2941cc171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c9ae13-d3d9-4f62-8949-24f7388353cb', 'volume_name': 'volume-65c9ae13-d3d9-4f62-8949-24f7388353cb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00278fa7-0174-40bb-8fba-e96f518c867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00278fa7-0174-40bb-8fba-e96f518c867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d4d354-38d6-463f-a0b2-01fa32cd6854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume 65c9ae13-d3d9-4f62-8949-24f7388353cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c9ae13-d3d9-4f62-8949-24f7388353cb', 'volume_size': 1} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1710589704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c9ae13-d3d9-4f62-8949-24f7388353cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5963aa628042e4a04bdc72c02cfb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:28Z,use_quota=True,user_id='56ad29d02d7a439bae0a2c6a01d2ef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Creating volume 65c9ae13-d3d9-4f62-8949-24f7388353cb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:07:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:28 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb 1073741824 Nov 03 12:07:28 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:29 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb 1073741824" returned: 0 in 0.889s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:29 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb Nov 03 12:07:29 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:29 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb" returned: 0 in 0.305s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d4d354-38d6-463f-a0b2-01fa32cd6854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c9ae13-d3d9-4f62-8949-24f7388353cb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150f531f-2a91-4206-8f9e-b9d1f58d3bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume volume-65c9ae13-d3d9-4f62-8949-24f7388353cb (65c9ae13-d3d9-4f62-8949-24f7388353cb): created successfully Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150f531f-2a91-4206-8f9e-b9d1f58d3bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Flow 'volume_create_manager' (06bf6d63-7d93-46be-bfe3-f4d2eb4a344b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1213642c-742b-4a16-8b9d-33aa5e29dc33 tempest-VolumeQuotasAdminTestJSON-697083402 None] Created volume successfully. Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "cinder-65c9ae13-d3d9-4f62-8949-24f7388353cb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "cinder-65c9ae13-d3d9-4f62-8949-24f7388353cb-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "cinder-quobyte-65c9ae13-d3d9-4f62-8949-24f7388353cb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "cinder-quobyte-65c9ae13-d3d9-4f62-8949-24f7388353cb" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae72edc9-1d86-4b17-b2c2-9c3c1d3ea728]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:31 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb Nov 03 12:07:31 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:31 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:31 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb Nov 03 12:07:31 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:32 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65c9ae13-d3d9-4f62-8949-24f7388353cb" returned: 0 in 0.592s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "cinder-quobyte-65c9ae13-d3d9-4f62-8949-24f7388353cb" released by "delete_volume" :: held 1.502s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Created reservations ['d7c3d618-32ee-430d-880e-239d183c69e7', 'c54639db-75f7-46ba-8d89-4bd0d13f48c8', 'cddf3ef1-3ef9-46df-ac21-d5746c506239', '41cc7ebb-68ab-44ea-96b2-200aa312417d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:32 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:32 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:33 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.477s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Deleted volume successfully. Nov 03 12:07:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cb90f96-95bc-47fc-b737-9cdf37bed0f2 tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "cinder-65c9ae13-d3d9-4f62-8949-24f7388353cb-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Flow 'volume_create_manager' (43f440f2-c9c8-4c0f-a6cd-fe8df4a13c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd66d2-4c85-4f86-8d70-52e80160cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd66d2-4c85-4f86-8d70-52e80160cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245854560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5963aa628042e4a04bdc72c02cfb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:34Z,use_quota=True,user_id='56ad29d02d7a439bae0a2c6a01d2ef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91d69ba-7cf1-433e-8925-f58d7a1cde8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91d69ba-7cf1-433e-8925-f58d7a1cde8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1d8288-d76a-41a4-963b-4dc932c776a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1d8288-d76a-41a4-963b-4dc932c776a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3', 'volume_name': 'volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fa276b-cc46-40b2-8aa6-998a522ac3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fa276b-cc46-40b2-8aa6-998a522ac3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d141c7e3-b572-4c63-8aad-06c6a033a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3', 'volume_size': 1} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245854560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5963aa628042e4a04bdc72c02cfb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:34Z,use_quota=True,user_id='56ad29d02d7a439bae0a2c6a01d2ef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Creating volume bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:07:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:34 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 1073741824 Nov 03 12:07:34 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:34 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 1073741824" returned: 0 in 0.489s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:34 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 Nov 03 12:07:34 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:35 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" returned: 0 in 0.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d141c7e3-b572-4c63-8aad-06c6a033a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb31f6-947f-4c60-bed4-37b5740d1e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Volume volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 (bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3): created successfully Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb31f6-947f-4c60-bed4-37b5740d1e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Flow 'volume_create_manager' (43f440f2-c9c8-4c0f-a6cd-fe8df4a13c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a3467095-8e1d-4c8a-93fc-39441370016c tempest-VolumeQuotasAdminTestJSON-697083402 None] Created volume successfully. Nov 03 12:07:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-98fd7289-7f57-452f-84e7-b2a865eb67b2 tempest-VolumeQuotasAdminTestJSON-1307796987 None] Transfer volume completed successfully. Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Acquiring lock "cinder-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "cinder-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Acquiring lock "cinder-quobyte-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "cinder-quobyte-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53160e92-9a66-4859-90bb-352fa7c06b5b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:38 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 Nov 03 12:07:38 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:38 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:38 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3 Nov 03 12:07:38 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:39 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "cinder-quobyte-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3" released by "delete_volume" :: held 0.700s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Created reservations ['4fa2d30f-a5f8-40d3-8a0e-f22ce4a2673b', 'd7fa98f7-ae20-4ef0-ab09-298f55c484b5', '31c51191-92da-42ce-8a76-5daba3c7ab7b', 'd4b3a63d-9aed-44ea-b411-cc4e1bb42d10'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:39 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:39 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:39 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.541s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Deleted volume successfully. Nov 03 12:07:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c67b952-f40c-46fe-9dbe-d650e0873788 tempest-VolumeQuotasAdminTestJSON-287405756 None] Lock "cinder-bb4bcdc8-24b2-4b67-82d5-916e3e5c48e3-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-ef5b9599-5fa8-41e3-8f67-541f249cfa78 tempest-ServerActionsTestOtherA-438295809 None] Terminate volume connection completed successfully. Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-ef5b9599-5fa8-41e3-8f67-541f249cfa78 tempest-ServerActionsTestOtherA-438295809 None] Deleting attachment 326ce5f0-6ea4-493a-bda2-460b28bc729e. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "cinder-ffbf93ee-557f-4a47-8ef6-72e68131eaf5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-ffbf93ee-557f-4a47-8ef6-72e68131eaf5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "cinder-quobyte-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-quobyte-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed33de5-80eb-4be4-ba32-441e14ebde4d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:48 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 Nov 03 12:07:48 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:48 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" returned: 0 in 0.582s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:48 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5 Nov 03 12:07:48 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:48 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-quobyte-ffbf93ee-557f-4a47-8ef6-72e68131eaf5" released by "delete_volume" :: held 0.920s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG cinder.quota [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Created reservations ['60af53de-60f4-4605-a1d0-1abbe864f971', '725f337d-d5c5-44fe-8329-09782738b2fc', '0886bf9e-5b9e-4c30-aa98-5c15f73039d9', 'ab4e03aa-b2a5-4e41-bfe7-9139e559b37b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:48 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:48 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:49 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.manager [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Deleted volume successfully. Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-f52fd918-9dd6-445b-a657-027f2653cb39 req-d04f8dd9-d0f3-421f-b803-176af293350d tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-ffbf93ee-557f-4a47-8ef6-72e68131eaf5-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "cinder-52af1292-979e-400d-b8fa-112cd6ddc340-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-52af1292-979e-400d-b8fa-112cd6ddc340-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "cinder-quobyte-52af1292-979e-400d-b8fa-112cd6ddc340" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-quobyte-52af1292-979e-400d-b8fa-112cd6ddc340" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5802b5-5e3e-497f-8d81-f8b3d3310f0b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Flow 'volume_create_manager' (77231b6c-2a96-4769-b512-70de1f6ab5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6220431-0b74-4cf8-a41e-669c1c05b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6220431-0b74-4cf8-a41e-669c1c05b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1849488198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fe03566d9241b282614e16de5fb5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:50Z,use_quota=True,user_id='db5420bbb8f0495a99c638b27b812ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d6fed5-fd35-49c0-b83a-3f50c626b9dc),volume_type_id=26d6fed5-fd35-49c0-b83a-3f50c626b9dc)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d603e0-4d40-4371-bb66-706b6771cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d603e0-4d40-4371-bb66-706b6771cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf8909d-0b72-43a2-9653-c02967e5f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf8909d-0b72-43a2-9653-c02967e5f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e', 'volume_name': 'volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da9e8de-4ae5-4408-a102-68cf4db18021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da9e8de-4ae5-4408-a102-68cf4db18021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba7d0f9-da9a-4504-b4e2-570a12fac5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Volume 4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e', 'volume_size': 1} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1849488198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fe03566d9241b282614e16de5fb5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:07:50Z,use_quota=True,user_id='db5420bbb8f0495a99c638b27b812ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d6fed5-fd35-49c0-b83a-3f50c626b9dc),volume_type_id=26d6fed5-fd35-49c0-b83a-3f50c626b9dc)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Creating volume 4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:07:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:07:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:49 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 Nov 03 12:07:49 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:49 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e 1073741824 Nov 03 12:07:49 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:50 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340" returned: 0 in 0.542s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:50 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340 Nov 03 12:07:50 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:50 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e 1073741824" returned: 0 in 0.525s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:50 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e Nov 03 12:07:50 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:50 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52af1292-979e-400d-b8fa-112cd6ddc340" returned: 0 in 0.328s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-quobyte-52af1292-979e-400d-b8fa-112cd6ddc340" released by "delete_volume" :: held 0.947s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Created reservations ['555b6c8a-580f-45f6-83ae-014a3f364784', '98eea368-c02d-4056-8287-6049798458b9', 'd4a44756-9d3e-4f1f-9b51-837d5948737b', '3af7f36b-2706-4bf1-b77a-bed6050979a9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:50 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba7d0f9-da9a-4504-b4e2-570a12fac5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2f7d9-5d8c-47a3-9f00-3c0a17a9c118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:07:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Volume volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e (4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e): created successfully Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2f7d9-5d8c-47a3-9f00-3c0a17a9c118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Flow 'volume_create_manager' (77231b6c-2a96-4769-b512-70de1f6ab5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:07:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-67b3397e-e7b0-4ac6-9375-5f3fc756317b tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Created volume successfully. Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:50 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:50 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:51 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.298s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:51 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Deleted volume successfully. Nov 03 12:07:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e89936c-9121-4ddb-a585-62f4cc525557 tempest-ServerActionsTestOtherA-438295809 None] Lock "cinder-52af1292-979e-400d-b8fa-112cd6ddc340-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:52 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:52 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:52 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:52 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3402929c-d3af-4232-8f37-bc7e4e09a9b7 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Retype volume completed successfully. Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "cinder-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "cinder-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "cinder-quobyte-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "cinder-quobyte-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617382e-0ac4-43d7-a5ad-d9d7ba159f3b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:07:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:54 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e Nov 03 12:07:54 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:54 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" returned: 0 in 0.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:54 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e Nov 03 12:07:54 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:54 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" returned: 0 in 0.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "cinder-quobyte-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e" released by "delete_volume" :: held 0.828s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:54 devstack cinder-volume[86561]: WARNING cinder.quota [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:07:54 devstack cinder-volume[86561]: WARNING cinder.quota [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Created reservations ['b9528864-f2d2-4373-aeb5-b6aec4d7723a', 'f30c65a1-99c8-4fe2-bf31-8582b0f74e81', 'c9e7e361-2e21-473a-bd9e-0630f2121603', 'e9bc758b-04d9-4025-8d5a-f13061b95bb0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:07:54 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:07:54 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:07:55 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Nov 03 12:07:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.444s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:07:55 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:07:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Deleted volume successfully. Nov 03 12:07:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-242e6c38-1dd2-498e-ad2b-ef84180a7249 tempest-VolumeRetypeWithoutMigrationTest-866953594 None] Lock "cinder-4b2964f7-2fe5-42b5-8fb7-62bb4e714f3e-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:07:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5aff64dd-9399-4b6f-8628-5cc6b1461409 req-ecb115f8-c57c-49ce-8588-79049824246b tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:07:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5aff64dd-9399-4b6f-8628-5cc6b1461409 req-ecb115f8-c57c-49ce-8588-79049824246b tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:07:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5aff64dd-9399-4b6f-8628-5cc6b1461409 req-ecb115f8-c57c-49ce-8588-79049824246b tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:07:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-5aff64dd-9399-4b6f-8628-5cc6b1461409 req-ecb115f8-c57c-49ce-8588-79049824246b tempest-TaggedAttachmentsTest-1666946828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bbaa62f-e6bc-4b90-b2c3-aeca3431aff1', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:07:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-5aff64dd-9399-4b6f-8628-5cc6b1461409 req-ecb115f8-c57c-49ce-8588-79049824246b tempest-TaggedAttachmentsTest-1666946828 None] attachment_update completed successfully. Nov 03 12:08:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-35710d07-8048-4e83-8592-ea6f384ba7e7 req-3869fd54-8afd-496c-ace0-4909f48161aa tempest-TaggedAttachmentsTest-1666946828 None] Terminate volume connection completed successfully. Nov 03 12:08:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-35710d07-8048-4e83-8592-ea6f384ba7e7 req-3869fd54-8afd-496c-ace0-4909f48161aa tempest-TaggedAttachmentsTest-1666946828 None] Deleting attachment 8bbaa62f-e6bc-4b90-b2c3-aeca3431aff1. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:08:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (52ac4c3d-b6b0-4de6-ae70-0777721a6e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9180eee-8d02-4786-900f-ef13d7743c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9180eee-8d02-4786-900f-ef13d7743c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-366473442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b412cf-7834-4100-86ff-d382fe44bf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:02Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c9b31a-0e20-4738-8ff5-9a2bdc2f35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c9b31a-0e20-4738-8ff5-9a2bdc2f35c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130f2c8-605a-4a06-9dcb-8f5ace79a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130f2c8-605a-4a06-9dcb-8f5ace79a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b412cf-7834-4100-86ff-d382fe44bf3e', 'volume_name': 'volume-32b412cf-7834-4100-86ff-d382fe44bf3e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1695e98d-75f5-4024-8fe6-7fc2188ceb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1695e98d-75f5-4024-8fe6-7fc2188ceb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0aa343b-e505-4bec-a5e8-2a7bb809a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Volume 32b412cf-7834-4100-86ff-d382fe44bf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b412cf-7834-4100-86ff-d382fe44bf3e', 'volume_size': 1} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-366473442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b412cf-7834-4100-86ff-d382fe44bf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:02Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Creating volume 32b412cf-7834-4100-86ff-d382fe44bf3e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:08:02 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:08:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:02 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e 1073741824 Nov 03 12:08:02 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:03 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e 1073741824" returned: 0 in 0.911s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:03 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e Nov 03 12:08:03 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:03 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e" returned: 0 in 0.305s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0aa343b-e505-4bec-a5e8-2a7bb809a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b412cf-7834-4100-86ff-d382fe44bf3e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5d9792-b747-40f9-a038-c3ab288eb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Volume volume-32b412cf-7834-4100-86ff-d382fe44bf3e (32b412cf-7834-4100-86ff-d382fe44bf3e): created successfully Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5d9792-b747-40f9-a038-c3ab288eb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (52ac4c3d-b6b0-4de6-ae70-0777721a6e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ffb2318e-9640-4da0-b7f6-432a86abfc8c tempest-AttachVolumeTestJSON-169687713 None] Created volume successfully. Nov 03 12:08:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-effca700-28c5-48bb-8675-d1438aea6a60 req-df451a39-2cbc-4247-8e61-012d7a50d9e5 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-effca700-28c5-48bb-8675-d1438aea6a60 req-df451a39-2cbc-4247-8e61-012d7a50d9e5 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-effca700-28c5-48bb-8675-d1438aea6a60 req-df451a39-2cbc-4247-8e61-012d7a50d9e5 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-effca700-28c5-48bb-8675-d1438aea6a60 req-df451a39-2cbc-4247-8e61-012d7a50d9e5 tempest-AttachVolumeTestJSON-169687713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-32b412cf-7834-4100-86ff-d382fe44bf3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29a2abf0-5d54-4237-89dd-9e427cf11049', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:08:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-effca700-28c5-48bb-8675-d1438aea6a60 req-df451a39-2cbc-4247-8e61-012d7a50d9e5 tempest-AttachVolumeTestJSON-169687713 None] attachment_update completed successfully. Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (bfebcfa6-5f08-41de-83e6-3c4a4f74bd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92dce37-a459-49cb-bed4-dba75ae7d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92dce37-a459-49cb-bed4-dba75ae7d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1609401280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4614fd0-156b-44e4-a343-3a011c6af642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:08Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e967c6a3-3422-4ebf-b200-e3986d1b85cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e967c6a3-3422-4ebf-b200-e3986d1b85cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381407f7-2a59-42a8-aaaf-c41635c6453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381407f7-2a59-42a8-aaaf-c41635c6453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4614fd0-156b-44e4-a343-3a011c6af642', 'volume_name': 'volume-c4614fd0-156b-44e4-a343-3a011c6af642', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7f94b7-465f-489d-b6df-0e112e950e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7f94b7-465f-489d-b6df-0e112e950e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c597af-1586-4af7-89bd-23d5516bd720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Volume c4614fd0-156b-44e4-a343-3a011c6af642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4614fd0-156b-44e4-a343-3a011c6af642', 'volume_size': 1} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1609401280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4614fd0-156b-44e4-a343-3a011c6af642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020e29fade424dc9be6e93812354c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:08Z,use_quota=True,user_id='91ce22c444da426e8e166e65de6a5bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Creating volume c4614fd0-156b-44e4-a343-3a011c6af642 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:08:08 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:08:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:08 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 1073741824 Nov 03 12:08:08 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:09 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 1073741824" returned: 0 in 0.598s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:09 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 Nov 03 12:08:09 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:09 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c597af-1586-4af7-89bd-23d5516bd720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4614fd0-156b-44e4-a343-3a011c6af642', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3799c07d-a6a4-40fd-9e79-f247af7c5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Volume volume-c4614fd0-156b-44e4-a343-3a011c6af642 (c4614fd0-156b-44e4-a343-3a011c6af642): created successfully Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3799c07d-a6a4-40fd-9e79-f247af7c5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Flow 'volume_create_manager' (bfebcfa6-5f08-41de-83e6-3c4a4f74bd07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2be4fbcc-0584-4078-a5c0-0cd2e7f6bb67 tempest-AttachVolumeTestJSON-169687713 None] Created volume successfully. Nov 03 12:08:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c3684af0-671a-4125-a3e3-ae531f97e5e1 req-d10fa66c-ea2c-48bc-914e-75fec2699404 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c3684af0-671a-4125-a3e3-ae531f97e5e1 req-d10fa66c-ea2c-48bc-914e-75fec2699404 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c3684af0-671a-4125-a3e3-ae531f97e5e1 req-d10fa66c-ea2c-48bc-914e-75fec2699404 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c3684af0-671a-4125-a3e3-ae531f97e5e1 req-d10fa66c-ea2c-48bc-914e-75fec2699404 tempest-AttachVolumeTestJSON-169687713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-c4614fd0-156b-44e4-a343-3a011c6af642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77134ce3-8f59-4c3a-9161-c76e451b6a42', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:08:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c3684af0-671a-4125-a3e3-ae531f97e5e1 req-d10fa66c-ea2c-48bc-914e-75fec2699404 tempest-AttachVolumeTestJSON-169687713 None] attachment_update completed successfully. Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Flow 'volume_create_manager' (9cc7c3eb-89fd-48f0-80d9-211b7322bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ee8b4b-a5db-4757-b94b-7da0ff18833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ee8b4b-a5db-4757-b94b-7da0ff18833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219903919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8945b648-4bd5-40dc-a6cc-2add5e8f1c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f089bff3004143d6943f7e5d992e35e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:13Z,use_quota=True,user_id='84cff5ff04ec4b2f9bc401a696e94a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61520107-8947-4f5c-8f38-a8b04a6fbc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61520107-8947-4f5c-8f38-a8b04a6fbc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5a4208-9902-4942-9e60-2c6b0b38b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5a4208-9902-4942-9e60-2c6b0b38b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8945b648-4bd5-40dc-a6cc-2add5e8f1c01', 'volume_name': 'volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b88bad-8be0-4f73-8e38-b3b71ffe9a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b88bad-8be0-4f73-8e38-b3b71ffe9a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e996fed-15f5-4164-b78d-118cad6b4221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Volume 8945b648-4bd5-40dc-a6cc-2add5e8f1c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01', 'volume_size': 1} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219903919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8945b648-4bd5-40dc-a6cc-2add5e8f1c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f089bff3004143d6943f7e5d992e35e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:13Z,use_quota=True,user_id='84cff5ff04ec4b2f9bc401a696e94a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Creating volume 8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:08:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:08:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:12 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 1073741824 Nov 03 12:08:12 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "cinder-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "cinder-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "cinder-quobyte-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "cinder-quobyte-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ffeab-c8c4-4fc4-8d66-9edffc0624ac]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:13 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 Nov 03 12:08:13 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:13 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 1073741824" returned: 0 in 0.716s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:13 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 Nov 03 12:08:13 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:14 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" returned: 0 in 0.596s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:14 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9 Nov 03 12:08:14 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:14 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" returned: 0 in 0.436s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e996fed-15f5-4164-b78d-118cad6b4221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b22279-41eb-4490-b136-ed28ef390d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Volume volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 (8945b648-4bd5-40dc-a6cc-2add5e8f1c01): created successfully Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b22279-41eb-4490-b136-ed28ef390d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Flow 'volume_create_manager' (9cc7c3eb-89fd-48f0-80d9-211b7322bb00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-25261c84-f69a-4f89-88dd-3a3488e0d340 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Created volume successfully. Nov 03 12:08:14 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" returned: 0 in 0.341s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "cinder-quobyte-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9" released by "delete_volume" :: held 1.004s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Created reservations ['779737a6-30e3-4c29-9557-23bdeef28413', '0cba1ec5-eb08-4b28-8f80-9c0c271e992e', '73306705-99c7-4770-b0bf-95f9350fef23', '33b58235-d0ef-4654-98b7-2763a3818d56'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:14 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:14 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-dfa8261f-badd-400c-a1d9-cbe9f413a3b6 req-6496f0a3-1836-452a-a88c-2aac47240824 tempest-AttachVolumeTestJSON-169687713 None] Terminate volume connection completed successfully. Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dfa8261f-badd-400c-a1d9-cbe9f413a3b6 req-6496f0a3-1836-452a-a88c-2aac47240824 tempest-AttachVolumeTestJSON-169687713 None] Deleting attachment 29a2abf0-5d54-4237-89dd-9e427cf11049. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:08:14 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Deleted volume successfully. Nov 03 12:08:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-18482502-3314-4f3b-b9d8-ed807acca45f tempest-TaggedAttachmentsTest-1666946828 None] Lock "cinder-f14ca468-abf2-4cf4-8427-b78fdcf5c9f9-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Creating offline snapshot 6786cf33-faab-461c-b3dc-4e8c733ac537 of volume 8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[293231d5-85e4-4322-8722-d4e273160af3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:15 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 Nov 03 12:08:15 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:15 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" returned: 0 in 0.544s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:15 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 1G Nov 03 12:08:15 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-309805e7-c27b-49c7-9c1b-c328c1bc3efe req-38148488-48f2-44ba-baf2-e1a022841cdd tempest-AttachVolumeTestJSON-169687713 None] Terminate volume connection completed successfully. Nov 03 12:08:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-309805e7-c27b-49c7-9c1b-c328c1bc3efe req-38148488-48f2-44ba-baf2-e1a022841cdd tempest-AttachVolumeTestJSON-169687713 None] Deleting attachment 77134ce3-8f59-4c3a-9161-c76e451b6a42. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:08:16 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 1G" returned: 0 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:16 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 Nov 03 12:08:16 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:16 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 is being set with open permissions: ugo+rw Nov 03 12:08:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:16 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 Nov 03 12:08:16 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:17 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537" returned: 0 in 0.351s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:17 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info Nov 03 12:08:17 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:17 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:17 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info is being set with open permissions: ugo+rw Nov 03 12:08:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:17 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info Nov 03 12:08:17 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:18 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.info" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-85dec00b-061f-44d5-a970-b91de544d1fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Create snapshot completed successfully Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "cinder-6786cf33-faab-461c-b3dc-4e8c733ac537-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-6786cf33-faab-461c-b3dc-4e8c733ac537-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "cinder-quobyte-6786cf33-faab-461c-b3dc-4e8c733ac537" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-6786cf33-faab-461c-b3dc-4e8c733ac537" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Deleting offline snapshot 6786cf33-faab-461c-b3dc-4e8c733ac537 of volume 8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] snapshot_file for this snap is: volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2980f-966d-45d4-b0b5-66ef052f6ea6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:19 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 Nov 03 12:08:19 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:19 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537" returned: 0 in 0.489s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[80780706-ddba-4ca1-a16c-e4a4188fa7d9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:19 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 Nov 03 12:08:19 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:20 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" returned: 0 in 0.620s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:20 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 Nov 03 12:08:20 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:20 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537" returned: 0 in 0.459s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:20 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537 Nov 03 12:08:20 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:20 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01.6786cf33-faab-461c-b3dc-4e8c733ac537" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-6786cf33-faab-461c-b3dc-4e8c733ac537" released by "_delete_snapshot" :: held 2.109s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" released by "delete_snapshot" :: held 2.145s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Created reservations ['adcc6d86-a7fc-4a82-ae93-0aff63292b76', 'c6a8b156-4852-469b-9d1a-8ce57f45fd3e', '9b25e2c9-58f3-4fe0-b6d0-ec7382387a79', 'c07657e0-2a95-490f-bbef-b1f7f1b98edb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Delete snapshot completed successfully. Nov 03 12:08:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-55b4a664-2e2e-4cec-9251-54efcf808e34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-6786cf33-faab-461c-b3dc-4e8c733ac537-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "cinder-8945b648-4bd5-40dc-a6cc-2add5e8f1c01-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-8945b648-4bd5-40dc-a6cc-2add5e8f1c01-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9815d-e374-49fc-a577-e279fb58fcaf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:22 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 Nov 03 12:08:22 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:22 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" returned: 0 in 0.503s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:22 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01 Nov 03 12:08:22 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:23 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-quobyte-8945b648-4bd5-40dc-a6cc-2add5e8f1c01" released by "delete_volume" :: held 0.997s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Created reservations ['4bd77d08-3b99-4ea5-8d8b-ea44ee573262', 'bbfbf323-aee7-42cf-91ab-ac39d9fc0a61', 'de280f2c-6674-4332-990a-f6ceca4f863c', '58449121-4199-4971-be90-9f22fe77a642'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:23 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:23 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:23 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Deleted volume successfully. Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23181614-4952-405a-964d-6bbe61e5d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1221648308 None] Lock "cinder-8945b648-4bd5-40dc-a6cc-2add5e8f1c01-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-c4614fd0-156b-44e4-a343-3a011c6af642-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-c4614fd0-156b-44e4-a343-3a011c6af642-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-quobyte-c4614fd0-156b-44e4-a343-3a011c6af642" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-c4614fd0-156b-44e4-a343-3a011c6af642" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea69f9-3fe2-4a4d-adca-0436be9af8a4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:24 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:24 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:24 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 Nov 03 12:08:24 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:24 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:08:24 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642" returned: 0 in 0.512s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:24 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642 Nov 03 12:08:24 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:25 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4614fd0-156b-44e4-a343-3a011c6af642" returned: 0 in 0.372s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-c4614fd0-156b-44e4-a343-3a011c6af642" released by "delete_volume" :: held 0.988s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=88,cinder:UPDATE=102,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=91,cinder:UPDATE=80,cinder:DELETE=11,cinder:INSERT=19 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Created reservations ['4a2f7076-e13f-4dc7-8c71-5242ca0a50f0', 'e51ea111-fc3e-4440-b532-98ed924404a0', '827d22c2-8abf-4aaf-99d0-0ebcdb962dc2', '28d9b6f3-cf07-41c1-822d-cb5009428c37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:25 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:25 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:25 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Deleted volume successfully. Nov 03 12:08:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a32627e3-1e78-4d35-8fa3-f0afcd8672e4 tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-c4614fd0-156b-44e4-a343-3a011c6af642-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-32b412cf-7834-4100-86ff-d382fe44bf3e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-32b412cf-7834-4100-86ff-d382fe44bf3e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-quobyte-32b412cf-7834-4100-86ff-d382fe44bf3e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-32b412cf-7834-4100-86ff-d382fe44bf3e" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe24de-5807-4ad2-855b-3af43b54c44c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:26 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e Nov 03 12:08:26 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:26 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e" returned: 0 in 0.420s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:26 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e Nov 03 12:08:26 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:27 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-32b412cf-7834-4100-86ff-d382fe44bf3e" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-32b412cf-7834-4100-86ff-d382fe44bf3e" released by "delete_volume" :: held 0.809s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Created reservations ['1de35eb6-cfce-4f1c-be7d-cd0acd689a9d', '49442d31-0e20-429a-b8aa-1529eb0b8f75', 'f52412f9-0e01-4e88-97af-9cb3fbf147e6', '8c339b40-f372-463e-a05c-774cc80cce4c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:27 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:27 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-991b2174-1eac-432a-9699-cea378e8891f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-991b2174-1eac-432a-9699-cea378e8891f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:27 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.375s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Deleted volume successfully. Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a65b768b-457b-402d-ad2b-f999725627ee tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-32b412cf-7834-4100-86ff-d382fe44bf3e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "cinder-quobyte-991b2174-1eac-432a-9699-cea378e8891f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-991b2174-1eac-432a-9699-cea378e8891f" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b99127-1120-4ab4-962f-a59050fbc5cc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:27 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f Nov 03 12:08:27 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:28 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f" returned: 0 in 0.581s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:28 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f Nov 03 12:08:28 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:28 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-991b2174-1eac-432a-9699-cea378e8891f" returned: 0 in 0.411s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-quobyte-991b2174-1eac-432a-9699-cea378e8891f" released by "delete_volume" :: held 1.068s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Created reservations ['82ccfcf6-0bbe-48af-9854-95fce26d1ed2', '43bb0101-ec05-4aad-9699-0f9ae27093c8', '0204512f-f45a-4557-b457-6f3905b14090', '95ed5a34-3c9c-47e7-9033-c8c56672235e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:29 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:08:29 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:29 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.646s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:08:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Deleted volume successfully. Nov 03 12:08:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-585520f0-6e05-4c7c-b619-833340a821bb tempest-AttachVolumeTestJSON-169687713 None] Lock "cinder-991b2174-1eac-432a-9699-cea378e8891f-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:08:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:INSERT=6,cinder:UPDATE=20,cinder:SELECT=12,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:08:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (b4dd94e3-07ab-44e4-9f64-ca93ca850e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a98489-b782-4aef-a062-5254b1e7f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a98489-b782-4aef-a062-5254b1e7f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1161081724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6694ad-7eca-49b9-9e1f-f346bb837715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d334c20dc4d6ba8faf398fb45e226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:50Z,use_quota=True,user_id='65bdd906fccb474ca8751501c278eb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5671f7-cb71-495a-aeb5-ccea0f0f4b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5671f7-cb71-495a-aeb5-ccea0f0f4b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dab976-634e-4daf-bc44-1a41337c3e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dab976-634e-4daf-bc44-1a41337c3e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6694ad-7eca-49b9-9e1f-f346bb837715', 'volume_name': 'volume-fb6694ad-7eca-49b9-9e1f-f346bb837715', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac1014-2cc3-4661-916a-453e6628dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac1014-2cc3-4661-916a-453e6628dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca7f885-b875-43fe-9d7f-50b246838f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Volume fb6694ad-7eca-49b9-9e1f-f346bb837715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6694ad-7eca-49b9-9e1f-f346bb837715', 'volume_size': 1} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1161081724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6694ad-7eca-49b9-9e1f-f346bb837715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d334c20dc4d6ba8faf398fb45e226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:08:50Z,use_quota=True,user_id='65bdd906fccb474ca8751501c278eb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Creating volume fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:08:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:08:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:50 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 1073741824 Nov 03 12:08:50 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:51 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 1073741824" returned: 0 in 1.092s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:51 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:08:51 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:51 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.484s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca7f885-b875-43fe-9d7f-50b246838f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6694ad-7eca-49b9-9e1f-f346bb837715', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54548582-3bea-4695-a2e1-55b197931001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:08:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Volume volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 (fb6694ad-7eca-49b9-9e1f-f346bb837715): created successfully Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54548582-3bea-4695-a2e1-55b197931001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:08:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (b4dd94e3-07ab-44e4-9f64-ca93ca850e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:08:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-caa0e1f5-830f-4915-a655-e8c7e51a7b07 tempest-VolumesDeleteCascade-1676954144 None] Created volume successfully. Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-800aa442-3492-448b-bc25-06efd8cde6a8 tempest-BackendsCapabilitiesAdminTestsJSON-1462350085 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.73637008667, 'free_capacity_gb': 1773.73637008667, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-15821796-b33c-4441-8c0e-20ef615e6dc7 tempest-BackendsCapabilitiesAdminTestsJSON-1462350085 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.73637008667, 'free_capacity_gb': 1773.73637008667, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Creating offline snapshot 359a0ee8-e4bf-4abc-b815-923776f78e1c of volume fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be99f8-d1ea-4816-8e8f-a228eefcdef7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:53 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:08:53 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:54 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.678s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:54 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c 1G Nov 03 12:08:54 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:54 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c 1G" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:55 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:08:55 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:55 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.598s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:55 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c is being set with open permissions: ugo+rw Nov 03 12:08:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:55 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:08:55 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:56 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.429s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:56 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info Nov 03 12:08:56 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:56 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info" returned: 0 in 0.380s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:56 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info is being set with open permissions: ugo+rw Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:56 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info Nov 03 12:08:56 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:56 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.info" returned: 0 in 0.306s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.422s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:08:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-016b3f5e-3df8-4089-96bc-2ee4098d3b0a tempest-VolumesDeleteCascade-1676954144 None] Create snapshot completed successfully Nov 03 12:08:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:08:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:08:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Creating offline snapshot fb1c16ec-e157-4ce4-9835-82a8464daceb of volume fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:08:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c4a71-b5c3-409c-8515-6dd0c98e2aa0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:08:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:58 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:08:58 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:58 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.448s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6694ad-7eca-49b9-9e1f-f346bb837715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:08:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:58 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb 1G Nov 03 12:08:58 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb 1G" returned: 0 in 0.693s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:59 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:59 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:08:59 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:08:59 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Nov 03 12:08:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.568s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:08:59 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb is being set with open permissions: ugo+rw Nov 03 12:08:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:08:59 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:08:59 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:00 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.572s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Flow 'volume_create_manager' (04007e4d-5737-4158-9c08-a0bd899d2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1f4435-caa3-492a-8fd8-25ae60b063c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1f4435-caa3-492a-8fd8-25ae60b063c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-131310439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6e8b97-6c72-493d-87d3-3376c7372078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a3b26929d34a5080b83e676f4379a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:00Z,use_quota=True,user_id='25a93ded7404455194d219a35468386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee61ee5-fad9-4a63-a64f-fb18c1beec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee61ee5-fad9-4a63-a64f-fb18c1beec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935567a7-51a6-4b2d-ab39-7a7df59a9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935567a7-51a6-4b2d-ab39-7a7df59a9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6e8b97-6c72-493d-87d3-3376c7372078', 'volume_name': 'volume-8d6e8b97-6c72-493d-87d3-3376c7372078', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebf5e9f-399c-4935-ab8b-44fabc21758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebf5e9f-399c-4935-ab8b-44fabc21758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea41f757-e366-4740-9476-d96d18f2d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Volume 8d6e8b97-6c72-493d-87d3-3376c7372078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6e8b97-6c72-493d-87d3-3376c7372078', 'volume_size': 1} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-131310439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6e8b97-6c72-493d-87d3-3376c7372078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a3b26929d34a5080b83e676f4379a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:00Z,use_quota=True,user_id='25a93ded7404455194d219a35468386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Creating volume 8d6e8b97-6c72-493d-87d3-3376c7372078 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bdd670e5-bb7a-4fd0-b145-1c508cfd2d48 tempest-VolumesDeleteCascade-1676954144 None] Create snapshot completed successfully Nov 03 12:09:00 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 1073741824 Nov 03 12:09:00 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-fb6694ad-7eca-49b9-9e1f-f346bb837715-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-fb6694ad-7eca-49b9-9e1f-f346bb837715-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Performing cascade delete. {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-359a0ee8-e4bf-4abc-b815-923776f78e1c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-359a0ee8-e4bf-4abc-b815-923776f78e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-359a0ee8-e4bf-4abc-b815-923776f78e1c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-359a0ee8-e4bf-4abc-b815-923776f78e1c" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Deleting offline snapshot 359a0ee8-e4bf-4abc-b815-923776f78e1c of volume fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:01 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] snapshot_file for this snap is: volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 1073741824" returned: 0 in 1.271s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1188a-47f3-4cad-af7c-fd42ee6bb81b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:01 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 Nov 03 12:09:01 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:02 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:09:02 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:02 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6694ad-7eca-49b9-9e1f-f346bb837715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6d7c3-17d4-4fc0-8092-476c79a0c88b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:02 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078" returned: 0 in 0.975s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea41f757-e366-4740-9476-d96d18f2d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6e8b97-6c72-493d-87d3-3376c7372078', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66e9aef-28ec-49ef-af3b-d1f5d2a37b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Volume volume-8d6e8b97-6c72-493d-87d3-3376c7372078 (8d6e8b97-6c72-493d-87d3-3376c7372078): created successfully Nov 03 12:09:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66e9aef-28ec-49ef-af3b-d1f5d2a37b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Flow 'volume_create_manager' (04007e4d-5737-4158-9c08-a0bd899d2c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b0ae41d6-75a1-41f0-859d-c076051086e8 tempest-ServersNegativeTestJSON-19192038 None] Created volume successfully. Nov 03 12:09:03 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:09:03 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:03 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.945s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ca3df-f317-4b6c-b7ed-9db0d2b930a3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:04 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:09:04 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:04 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6694ad-7eca-49b9-9e1f-f346bb837715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82731b0-f24d-43d6-9096-fff18655d230]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:04 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:09:04 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:05 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.811s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6694ad-7eca-49b9-9e1f-f346bb837715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee288e4-8284-462a-8c0a-2221807706f1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:05 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:09:05 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8f4c3317-ee66-4a66-9080-bc1ccd75a9af tempest-GroupSnapshotsV319Test-1158743838 None] Group tempest-GroupSnapshotsV319Test-Group-1811215014: creating Nov 03 12:09:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8f4c3317-ee66-4a66-9080-bc1ccd75a9af tempest-GroupSnapshotsV319Test-1158743838 None] Group tempest-GroupSnapshotsV319Test-Group-1811215014: created successfully Nov 03 12:09:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8f4c3317-ee66-4a66-9080-bc1ccd75a9af tempest-GroupSnapshotsV319Test-1158743838 None] Create group completed successfully. Nov 03 12:09:06 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.890s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:06 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:09:06 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Flow 'volume_create_manager' (50610d65-4cd9-4e45-83ef-2ae7706d911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21378d6a-b125-4206-8412-6b9f82717084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21378d6a-b125-4206-8412-6b9f82717084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105984630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95522d40-3aed-4cbe-8f7e-08449928adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a3b26929d34a5080b83e676f4379a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:07Z,use_quota=True,user_id='25a93ded7404455194d219a35468386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c04b703-702d-4c35-951d-0a7cae6c95cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c04b703-702d-4c35-951d-0a7cae6c95cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0cd60a-1546-407d-bec9-e78eeef7caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0cd60a-1546-407d-bec9-e78eeef7caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95522d40-3aed-4cbe-8f7e-08449928adbd', 'volume_name': 'volume-95522d40-3aed-4cbe-8f7e-08449928adbd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930c41fb-9061-402c-902c-8a940de59b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:07 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930c41fb-9061-402c-902c-8a940de59b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2adae11-8ee9-4ec6-873e-0ab5c598a588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Volume 95522d40-3aed-4cbe-8f7e-08449928adbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95522d40-3aed-4cbe-8f7e-08449928adbd', 'volume_size': 1} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105984630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95522d40-3aed-4cbe-8f7e-08449928adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a3b26929d34a5080b83e676f4379a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:07Z,use_quota=True,user_id='25a93ded7404455194d219a35468386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Creating volume 95522d40-3aed-4cbe-8f7e-08449928adbd {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:07 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd 1073741824 Nov 03 12:09:07 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:07 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c Nov 03 12:09:07 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:08 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.359a0ee8-e4bf-4abc-b815-923776f78e1c" returned: 0 in 0.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb -F qcow2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:08 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb -F qcow2 Nov 03 12:09:08 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:08 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd 1073741824" returned: 0 in 0.973s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:08 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd Nov 03 12:09:08 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Flow 'volume_create_manager' (e5eb6598-6c5a-4e26-85da-33fe2a777498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eceabd56-d0cd-4de6-a5a7-82dd429b552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eceabd56-d0cd-4de6-a5a7-82dd429b552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1072691608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c64576-9048-4988-9f45-18d48377b150,host='devstack@QuobyteHD#QuobyteHD',id=e1ab0d0d-c183-42b0-a9fc-6111633693cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd381e95765440e69a2df2670ef67bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:08Z,use_quota=True,user_id='d2073cf7e9994885a292a92a9dd09329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dedd9aaf-7737-434f-9086-ec8758d79173),volume_type_id=dedd9aaf-7737-434f-9086-ec8758d79173)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3019d138-c6a3-4d69-8c10-c6dc558b3d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3019d138-c6a3-4d69-8c10-c6dc558b3d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653b9067-112f-4df5-b657-14d4f6aadef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653b9067-112f-4df5-b657-14d4f6aadef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ab0d0d-c183-42b0-a9fc-6111633693cf', 'volume_name': 'volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533db077-2088-400a-8b24-60a0e64d88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533db077-2088-400a-8b24-60a0e64d88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c38884-76cb-432a-9998-7c54952786ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Volume e1ab0d0d-c183-42b0-a9fc-6111633693cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf', 'volume_size': 1} Nov 03 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:09 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:09 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb -F qcow2" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd" returned: 0 in 0.631s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60c64576-9048-4988-9f45-18d48377b150,created_at=2026-11-03T11:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1072691608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c64576-9048-4988-9f45-18d48377b150,host='devstack@QuobyteHD#QuobyteHD',id=e1ab0d0d-c183-42b0-a9fc-6111633693cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd381e95765440e69a2df2670ef67bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:08Z,use_quota=True,user_id='d2073cf7e9994885a292a92a9dd09329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dedd9aaf-7737-434f-9086-ec8758d79173),volume_type_id=dedd9aaf-7737-434f-9086-ec8758d79173)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Creating volume e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-359a0ee8-e4bf-4abc-b815-923776f78e1c" released by "_delete_snapshot" :: held 7.371s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" released by "delete_snapshot" :: held 7.451s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2adae11-8ee9-4ec6-873e-0ab5c598a588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95522d40-3aed-4cbe-8f7e-08449928adbd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:09 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf 1073741824 Nov 03 12:09:09 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6232a516-d905-4df1-83e8-a3fb5561bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Volume volume-95522d40-3aed-4cbe-8f7e-08449928adbd (95522d40-3aed-4cbe-8f7e-08449928adbd): created successfully Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6232a516-d905-4df1-83e8-a3fb5561bf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Flow 'volume_create_manager' (50610d65-4cd9-4e45-83ef-2ae7706d911f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fb5d5a8e-2eb1-4c8e-a7ef-87ff7ec38a13 tempest-ServersNegativeTestJSON-19192038 None] Created volume successfully. Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['b76e7ac8-c08c-427f-ad28-a661ab664fb8', 'af3d826b-797c-4f16-87de-62252031f50e', '29ece33f-8380-4597-99d6-02cff8e6dccc', '43718811-ac84-45cb-aafa-3adb7c88ebf9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Delete snapshot completed successfully. Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-359a0ee8-e4bf-4abc-b815-923776f78e1c-delete_snapshot" released by "delete_snapshot" :: held 7.801s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-fb1c16ec-e157-4ce4-9835-82a8464daceb-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-fb1c16ec-e157-4ce4-9835-82a8464daceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-fb1c16ec-e157-4ce4-9835-82a8464daceb" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb1c16ec-e157-4ce4-9835-82a8464daceb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Deleting offline snapshot fb1c16ec-e157-4ce4-9835-82a8464daceb of volume fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] snapshot_file for this snap is: volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[55432416-11f8-405d-ac7b-d461b637bff2]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:09 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:09:09 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:09 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf 1073741824" returned: 0 in 0.655s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:09 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf Nov 03 12:09:09 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:10 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.643s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6694ad-7eca-49b9-9e1f-f346bb837715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b183660-0346-41bd-a611-2e4574501eca]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:10 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:09:10 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:10 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf" returned: 0 in 0.558s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c38884-76cb-432a-9998-7c54952786ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020ca39e-107d-43d1-aa00-9021856cef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Volume volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf (e1ab0d0d-c183-42b0-a9fc-6111633693cf): created successfully Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020ca39e-107d-43d1-aa00-9021856cef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Flow 'volume_create_manager' (e5eb6598-6c5a-4e26-85da-33fe2a777498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-caf9d695-cf17-467f-b74c-3796f5af7492 tempest-GroupSnapshotsV319Test-1158743838 None] Created volume successfully. Nov 03 12:09:10 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.604s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:10 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:09:10 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "cinder-95522d40-3aed-4cbe-8f7e-08449928adbd-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-95522d40-3aed-4cbe-8f7e-08449928adbd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "cinder-quobyte-95522d40-3aed-4cbe-8f7e-08449928adbd" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-quobyte-95522d40-3aed-4cbe-8f7e-08449928adbd" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2387731d-5b44-41fc-92c5-a1c7cef2e781]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:11 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd Nov 03 12:09:11 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:11 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.537s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:11 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb Nov 03 12:09:11 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:11 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd" returned: 0 in 0.619s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] GroupSnapshot b4a9a111-bed7-439b-b2a8-84826babf056: creating. Nov 03 12:09:11 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd Nov 03 12:09:11 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Group snapshot b4a9a111-bed7-439b-b2a8-84826babf056: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Creating offline snapshot dffd8027-a63b-4aa5-9e05-1b427f9e9e2a of volume e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d2651-fe01-41c3-b7a2-67fd913fd30d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:11 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715.fb1c16ec-e157-4ce4-9835-82a8464daceb" returned: 0 in 0.649s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb1c16ec-e157-4ce4-9835-82a8464daceb" released by "_delete_snapshot" :: held 2.642s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" released by "delete_snapshot" :: held 2.700s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:12 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf Nov 03 12:09:12 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['030d5d6d-13e8-4c88-a254-6ce2895ece65', '8a050b24-2476-414d-8698-824d6863c50f', '4845215e-ae14-4b9b-82de-7499a6865e85', '4653bb0c-ab13-4705-8ed6-37df4aec1498'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:12 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-95522d40-3aed-4cbe-8f7e-08449928adbd" returned: 0 in 0.640s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-quobyte-95522d40-3aed-4cbe-8f7e-08449928adbd" released by "delete_volume" :: held 1.348s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Delete snapshot completed successfully. Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-fb1c16ec-e157-4ce4-9835-82a8464daceb-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Snapshots deleted, issuing volume delete {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Created reservations ['8ba9e9f7-689f-4679-bad2-44332ee77112', 'c0a6e9bf-fa97-44dc-a241-db97cd8b1d78', 'cb77978f-df69-48a8-9ab6-dbc95c9f866c', '3a025e56-6bcc-472b-88dd-97bb14a518c0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927b4ac-43c0-4f5f-b607-146a55e4526a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:12 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:12 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:12 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:09:12 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:12 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf" returned: 0 in 0.990s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:12 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a 1G Nov 03 12:09:12 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:13 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.469s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Deleted volume successfully. Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7ea82f91-d932-4914-822f-a371539ad5fe tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-95522d40-3aed-4cbe-8f7e-08449928adbd-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:13 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.851s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "cinder-8d6e8b97-6c72-493d-87d3-3376c7372078-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:13 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715 Nov 03 12:09:13 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-8d6e8b97-6c72-493d-87d3-3376c7372078-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "cinder-quobyte-8d6e8b97-6c72-493d-87d3-3376c7372078" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-quobyte-8d6e8b97-6c72-493d-87d3-3376c7372078" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa1fa7-ac61-4482-8f5b-97364ed1b701]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:13 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fb6694ad-7eca-49b9-9e1f-f346bb837715" returned: 0 in 0.583s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:14 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a 1G" returned: 0 in 1.107s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-fb6694ad-7eca-49b9-9e1f-f346bb837715" released by "delete_volume" :: held 1.563s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:14 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 Nov 03 12:09:14 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:14 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a Nov 03 12:09:14 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['b6c5041a-2371-45aa-bcca-69100375246a', 'ebce18fd-030d-499a-8eaf-6c30e3a14337', 'b4471d61-0825-4f1c-a09c-a73cad9336b1', 'bf9fcea6-db8f-4086-867b-e6a12f2b1edb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:14 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:14 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:14 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078" returned: 0 in 0.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:14 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078 Nov 03 12:09:14 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:14 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" returned: 0 in 0.898s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:09:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:14 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a Nov 03 12:09:14 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:15 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.768s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Deleted volume successfully. Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce787b37-f144-476e-a720-f64f24c5b2f1 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-fb6694ad-7eca-49b9-9e1f-f346bb837715-delete_volume" released by "delete_volume" :: held 13.858s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:15 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" returned: 0 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:15 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info Nov 03 12:09:15 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:15 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Flow 'volume_create_manager' (d3bf2bbc-ae07-486f-87ef-c84e0304f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f8c5fc-33b7-4a32-a321-e5d5b3e8f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8d6e8b97-6c72-493d-87d3-3376c7372078" returned: 0 in 0.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f8c5fc-33b7-4a32-a321-e5d5b3e8f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-805698193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042ee43b-0477-4545-87b1-747e1a6cad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67ec012db24770b79d743e5e03e2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:15Z,use_quota=True,user_id='12bd40cf63704b339c53eb46f00339a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e02f2b-bf7d-4db7-81c6-9b15ebcece40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e02f2b-bf7d-4db7-81c6-9b15ebcece40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e6987-c18f-41f3-a4e6-8569a8d7b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e6987-c18f-41f3-a4e6-8569a8d7b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042ee43b-0477-4545-87b1-747e1a6cad09', 'volume_name': 'volume-042ee43b-0477-4545-87b1-747e1a6cad09', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2c332-33ac-4003-b032-61fc5c485de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2c332-33ac-4003-b032-61fc5c485de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9649b2a-91fb-4447-9840-fd2aba6d7fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Volume 042ee43b-0477-4545-87b1-747e1a6cad09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042ee43b-0477-4545-87b1-747e1a6cad09', 'volume_size': 1} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-quobyte-8d6e8b97-6c72-493d-87d3-3376c7372078" released by "delete_volume" :: held 1.779s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Created reservations ['54bf2178-2924-479c-bf15-953ad437de6a', '187564f0-ca93-474e-86cd-43bc841786c3', '38c364ce-60a8-4ac6-a725-394f80db47f4', '65bbc45c-889f-47bc-84e5-8e9bfd151b26'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:15 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:15 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:15 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info" returned: 0 in 0.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:09:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:15 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info Nov 03 12:09:15 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:16 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.529s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Deleted volume successfully. Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9637808-182b-407b-b3cf-7dd683e3628b tempest-ServersNegativeTestJSON-19192038 None] Lock "cinder-8d6e8b97-6c72-493d-87d3-3376c7372078-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:16 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.info" returned: 0 in 0.568s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-805698193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042ee43b-0477-4545-87b1-747e1a6cad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67ec012db24770b79d743e5e03e2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:15Z,use_quota=True,user_id='12bd40cf63704b339c53eb46f00339a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Creating volume 042ee43b-0477-4545-87b1-747e1a6cad09 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:16 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:16 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 1073741824 Nov 03 12:09:16 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-845d55b3-3890-4ebf-9d9e-3a4ff07cdcc5 tempest-GroupSnapshotsV319Test-1158743838 None] group_snapshot b4a9a111-bed7-439b-b2a8-84826babf056: created successfully Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (9570103a-e741-483e-a3d1-95f2b63ee624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fd6d1c-d148-449e-84ec-45ff9a8bcd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:17 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 1073741824" returned: 0 in 0.918s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fd6d1c-d148-449e-84ec-45ff9a8bcd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1044385370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c761e63e-4e1a-46a2-ba65-1825258b0d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d334c20dc4d6ba8faf398fb45e226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:17Z,use_quota=True,user_id='65bdd906fccb474ca8751501c278eb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f37c13-e1bb-448a-bbbb-3fdd5bf56a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f37c13-e1bb-448a-bbbb-3fdd5bf56a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c2b05-3b82-46d3-80b5-4c4464e2d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c2b05-3b82-46d3-80b5-4c4464e2d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c761e63e-4e1a-46a2-ba65-1825258b0d55', 'volume_name': 'volume-c761e63e-4e1a-46a2-ba65-1825258b0d55', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc515a8b-da06-48da-a552-188cdda2b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc515a8b-da06-48da-a552-188cdda2b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fde5cfd-41e0-4916-9c40-c963f62f112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Volume c761e63e-4e1a-46a2-ba65-1825258b0d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c761e63e-4e1a-46a2-ba65-1825258b0d55', 'volume_size': 1} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:17 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 Nov 03 12:09:17 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:18 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09" returned: 0 in 0.565s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1044385370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c761e63e-4e1a-46a2-ba65-1825258b0d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d334c20dc4d6ba8faf398fb45e226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:17Z,use_quota=True,user_id='65bdd906fccb474ca8751501c278eb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Creating volume c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:18 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:18 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 1073741824 Nov 03 12:09:18 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9649b2a-91fb-4447-9840-fd2aba6d7fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042ee43b-0477-4545-87b1-747e1a6cad09', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14d0997-6dad-4687-b349-ae90639ac740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Volume volume-042ee43b-0477-4545-87b1-747e1a6cad09 (042ee43b-0477-4545-87b1-747e1a6cad09): created successfully Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14d0997-6dad-4687-b349-ae90639ac740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Flow 'volume_create_manager' (d3bf2bbc-ae07-486f-87ef-c84e0304f601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-724d83ae-52f9-491d-bff0-b5bfbcb646fc tempest-ServerRescueNegativeTestJSON-445410369 None] Created volume successfully. Nov 03 12:09:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] group_snapshot b4a9a111-bed7-439b-b2a8-84826babf056: deleting Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] group_snapshot b4a9a111-bed7-439b-b2a8-84826babf056: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "cinder-quobyte-dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Deleting offline snapshot dffd8027-a63b-4aa5-9e05-1b427f9e9e2a of volume e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] snapshot_file for this snap is: volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78566d5-b9b7-4a1a-a683-c95f66de1805]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:18 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a Nov 03 12:09:18 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:19 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 1073741824" returned: 0 in 0.985s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:19 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:19 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:19 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f34671-8b74-48d0-8f69-d372c44df00b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:19 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.578s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fde5cfd-41e0-4916-9c40-c963f62f112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c761e63e-4e1a-46a2-ba65-1825258b0d55', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725cc40-81df-48d3-b9b1-ac6f9bbd7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Volume volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 (c761e63e-4e1a-46a2-ba65-1825258b0d55): created successfully Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725cc40-81df-48d3-b9b1-ac6f9bbd7113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (9570103a-e741-483e-a3d1-95f2b63ee624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:19 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf Nov 03 12:09:19 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-105028ce-b8ef-462d-9bed-7be18a7d15a8 tempest-VolumesDeleteCascade-1676954144 None] Created volume successfully. Nov 03 12:09:20 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf" returned: 0 in 0.643s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:20 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a Nov 03 12:09:20 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Creating offline snapshot b8ddfc3b-a86e-4a89-afdf-09a684147e42 of volume c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de51e876-4550-4a62-99f3-e8345f5ff390]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:20 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" returned: 0 in 0.556s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:20 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:20 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:20 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a Nov 03 12:09:20 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:21 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf.dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" returned: 0 in 0.355s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-dffd8027-a63b-4aa5-9e05-1b427f9e9e2a" released by "_delete_snapshot" :: held 2.468s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" released by "delete_snapshot" :: held 2.527s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:21 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.614s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:21 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 1G Nov 03 12:09:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-569367574 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-569367574, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:09:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-569367574 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-569367574, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] Created reservations ['97f45b5c-145d-40d1-9d83-514024886689', 'f2b88239-9951-4dfe-a007-57962f47c5ff', '9ad7f590-e9d3-4ab8-bb03-39b16e9b0058', '62ae6ebf-1a69-4fcd-bb94-b4a2b4d0a450'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:21 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-184af237-39ef-4a60-8c98-ac3cba5cf8f9 tempest-GroupSnapshotsV319Test-1158743838 None] group_snapshot b4a9a111-bed7-439b-b2a8-84826babf056: deleted successfully Nov 03 12:09:21 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 1G" returned: 0 in 0.642s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:21 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:21 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:22 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.620s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:22 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 is being set with open permissions: ugo+rw Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:22 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:22 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cbdeb1-5eee-4457-b2ee-e478bed110e8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:23 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.607s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:23 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf Nov 03 12:09:23 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:23 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info Nov 03 12:09:23 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:23 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info" returned: 0 in 0.633s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:23 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info is being set with open permissions: ugo+rw Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:23 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf" returned: 0 in 0.946s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:23 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info Nov 03 12:09:23 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:23 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf Nov 03 12:09:23 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:24 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:24 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:24 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.info" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-352b49e3-9149-42f7-88cf-91983e142d9f tempest-VolumesDeleteCascade-1676954144 None] Create snapshot completed successfully Nov 03 12:09:24 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1ab0d0d-c183-42b0-a9fc-6111633693cf" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Lock "cinder-quobyte-e1ab0d0d-c183-42b0-a9fc-6111633693cf" released by "delete_volume" :: held 2.028s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Created reservations ['dcc5d450-8169-43f3-8f31-ed12920ea379'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:24 devstack cinder-volume[86561]: WARNING cinder.quota [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-569367574 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-569367574, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Created reservations ['74fedd79-3307-4264-ae73-525205cdf037', 'f608ea68-042d-4699-9c87-f8657a8fabf8', '8200a6c8-2026-45dc-b761-618c656b8475', '3259d452-479d-4e81-a9ec-2f0eb1a2a0df'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:25 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 1.030s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:25 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:25 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:25 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.490s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ebcccf38-4b27-43d8-ae4d-f56c0f6f2a0a tempest-GroupSnapshotsV319Test-1158743838 None] Delete group completed successfully. Nov 03 12:09:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (35c64052-2e3d-4d08-a9fc-ecaa39a2b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc09325-ef61-41ae-99c6-2316772fde5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc09325-ef61-41ae-99c6-2316772fde5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-486464072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc429cf-1b1e-46ca-b756-f5531b61d5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d334c20dc4d6ba8faf398fb45e226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8ddfc3b-a86e-4a89-afdf-09a684147e42,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:27Z,use_quota=True,user_id='65bdd906fccb474ca8751501c278eb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2451e7-f8f8-4eb4-8f5a-55380e07ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2451e7-f8f8-4eb4-8f5a-55380e07ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95dbf02b-172f-44c8-8fe0-51ff77c48140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95dbf02b-172f-44c8-8fe0-51ff77c48140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bc429cf-1b1e-46ca-b756-f5531b61d5d0', 'volume_name': 'volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0', 'volume_size': 1, 'snapshot_id': 'b8ddfc3b-a86e-4a89-afdf-09a684147e42'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6fed3-8f88-4e4d-ae9a-1eb9b3275082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6fed3-8f88-4e4d-ae9a-1eb9b3275082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f31b3a-c619-493b-b927-c0a3b80569a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Volume 2bc429cf-1b1e-46ca-b756-f5531b61d5d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0', 'volume_size': 1, 'snapshot_id': 'b8ddfc3b-a86e-4a89-afdf-09a684147e42'} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Creating volume 2bc429cf-1b1e-46ca-b756-f5531b61d5d0 from snapshot b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] snapshot: b8ddfc3b-a86e-4a89-afdf-09a684147e42, volume: 2bc429cf-1b1e-46ca-b756-f5531b61d5d0, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d2fb3b-9928-4b33-96cf-1f21508643ad]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:27 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:27 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:27 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c761e63e-4e1a-46a2-ba65-1825258b0d55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[00158113-9c25-4ec3-b3fb-3f114c9b45dc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:28 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:28 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:28 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:09:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:28 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 Nov 03 12:09:28 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Acquiring lock "cinder-042ee43b-0477-4545-87b1-747e1a6cad09-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "cinder-042ee43b-0477-4545-87b1-747e1a6cad09-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Acquiring lock "cinder-quobyte-042ee43b-0477-4545-87b1-747e1a6cad09" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "cinder-quobyte-042ee43b-0477-4545-87b1-747e1a6cad09" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e768cb-99df-4fd4-88ab-5174b68f56b6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:31 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 Nov 03 12:09:31 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:32 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09" returned: 0 in 1.287s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:32 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09 Nov 03 12:09:32 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:33 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-042ee43b-0477-4545-87b1-747e1a6cad09" returned: 0 in 0.881s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "cinder-quobyte-042ee43b-0477-4545-87b1-747e1a6cad09" released by "delete_volume" :: held 2.342s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Created reservations ['e6620589-d8b2-4396-a96b-48a0c866637f', 'c415dc5f-955b-4b06-8759-79b4bd539e8a', 'f6203da3-4769-45fc-9479-97f72dce9dcd', '4304f723-19a0-4289-833c-8cd6b13ebd1e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:33 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:33 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:34 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Deleted volume successfully. Nov 03 12:09:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72c53384-751e-4c75-a1aa-a2580faf145e tempest-ServerRescueNegativeTestJSON-445410369 None] Lock "cinder-042ee43b-0477-4545-87b1-747e1a6cad09-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:42 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" returned: 0 in 13.443s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55, size 1024.00 MB, duration 13.44 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:09:42 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Converted 1024.00 MB image at 76.17 MB/s Nov 03 12:09:42 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 is being set with open permissions: ugo+rw Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:42 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 Nov 03 12:09:42 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:42 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" released by "_copy_volume_from_snapshot" :: held 15.276s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=83,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" released by "_create_volume_from_snapshot" :: held 15.406s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.422s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f31b3a-c619-493b-b927-c0a3b80569a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0', 'volume_size': 1, 'snapshot_id': 'b8ddfc3b-a86e-4a89-afdf-09a684147e42'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf7fc45-56f1-4c01-b937-48aa59f91585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Volume volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 (2bc429cf-1b1e-46ca-b756-f5531b61d5d0): created successfully Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf7fc45-56f1-4c01-b937-48aa59f91585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Flow 'volume_create_manager' (35c64052-2e3d-4d08-a9fc-ecaa39a2b543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b66df860-11d2-4f19-a57a-85c62078f1c2 tempest-VolumesDeleteCascade-1676954144 None] Created volume successfully. Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Flow 'volume_create_manager' (b4d91202-2125-480c-82ca-46116726d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96ffa77-1e5b-437e-b150-c4d5587e02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96ffa77-1e5b-437e-b150-c4d5587e02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-950644323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e9176-a0e9-421e-831a-3f75e9a92f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d3377fa2a48bfbeda9661b59db6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:43Z,use_quota=True,user_id='eb8ae2020a8f457781f6df4523a5e5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188dfecf-c376-48b0-93c6-a5d22fb88f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188dfecf-c376-48b0-93c6-a5d22fb88f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac4b6a8-d8a4-4c33-bed0-2c46639f78f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac4b6a8-d8a4-4c33-bed0-2c46639f78f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874e9176-a0e9-421e-831a-3f75e9a92f90', 'volume_name': 'volume-874e9176-a0e9-421e-831a-3f75e9a92f90', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf49f99-36be-4a02-887d-df58e23462f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf49f99-36be-4a02-887d-df58e23462f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f433013b-141e-4fb2-bc89-9e3f0d4f6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Volume 874e9176-a0e9-421e-831a-3f75e9a92f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874e9176-a0e9-421e-831a-3f75e9a92f90', 'volume_size': 1} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-950644323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e9176-a0e9-421e-831a-3f75e9a92f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d3377fa2a48bfbeda9661b59db6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:43Z,use_quota=True,user_id='eb8ae2020a8f457781f6df4523a5e5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Creating volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-c761e63e-4e1a-46a2-ba65-1825258b0d55-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-c761e63e-4e1a-46a2-ba65-1825258b0d55-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:43 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 1073741824 Nov 03 12:09:43 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Performing cascade delete. {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-b8ddfc3b-a86e-4a89-afdf-09a684147e42-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-b8ddfc3b-a86e-4a89-afdf-09a684147e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Deleting offline snapshot b8ddfc3b-a86e-4a89-afdf-09a684147e42 of volume c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] snapshot_file for this snap is: volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541d6a9-b5bb-4ccc-9572-5091d3845eeb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:43 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:43 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:43 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 1073741824" returned: 0 in 0.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:43 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.555s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c761e63e-4e1a-46a2-ba65-1825258b0d55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:43 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 Nov 03 12:09:43 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88127ff-ef32-4678-b01b-95a4ae550dd5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:44 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:44 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:44 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90" returned: 0 in 0.305s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f433013b-141e-4fb2-bc89-9e3f0d4f6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874e9176-a0e9-421e-831a-3f75e9a92f90', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb352d8d-41b0-41cd-8370-f3f9fd16a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Volume volume-874e9176-a0e9-421e-831a-3f75e9a92f90 (874e9176-a0e9-421e-831a-3f75e9a92f90): created successfully Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb352d8d-41b0-41cd-8370-f3f9fd16a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Flow 'volume_create_manager' (b4d91202-2125-480c-82ca-46116726d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-22d2bfad-f9d3-467c-b0d0-92c873893001 tempest-SnapshotsActionsTest-1157073383 None] Created volume successfully. Nov 03 12:09:44 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.697s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:44 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:44 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:45 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.453s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:45 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42 Nov 03 12:09:45 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Creating offline snapshot 2e09233f-2e35-4e61-a296-b03c33c7cfd4 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec66caba-1c7b-46bc-83fd-aaf5d73b37cd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:45 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 Nov 03 12:09:45 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:45 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55.b8ddfc3b-a86e-4a89-afdf-09a684147e42" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-b8ddfc3b-a86e-4a89-afdf-09a684147e42" released by "_delete_snapshot" :: held 2.286s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" released by "delete_snapshot" :: held 2.339s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['559fb18a-0371-47b1-a788-0a1f738e86cf', 'fda92bd7-2a0a-4032-bf5b-2a97507e9c4f', '2d155007-d57b-431a-9e54-11d0479f1fd6', '4873fcd3-f963-4f8f-95e6-be56ae9e743d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Delete snapshot completed successfully. Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-b8ddfc3b-a86e-4a89-afdf-09a684147e42-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Snapshots deleted, issuing volume delete {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ac47eb-fb00-4795-8bcc-bd759cd8cf68]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:45 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:45 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 1G Nov 03 12:09:45 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:45 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:45 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:46 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.424s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:46 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55 Nov 03 12:09:46 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:46 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 1G" returned: 0 in 0.489s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:46 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:46 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:46 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c761e63e-4e1a-46a2-ba65-1825258b0d55" returned: 0 in 0.390s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-c761e63e-4e1a-46a2-ba65-1825258b0d55" released by "delete_volume" :: held 0.893s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['54c6eb96-e26a-4d78-8da8-a20d57aa86ac', 'f7106707-d4df-4f65-b957-a26a20c2905e', '6174eed5-3798-4536-b6b2-26e450c7d2db', '9ee880b2-7989-4bad-ba57-ebce3be44092'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:46 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 is being set with open permissions: ugo+rw Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:46 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:46 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:46 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:46 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:47 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.340s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:47 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info Nov 03 12:09:47 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:47 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.421s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Deleted volume successfully. Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c207e7c0-7cf1-4c8c-aa66-81544c316a23 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-c761e63e-4e1a-46a2-ba65-1825258b0d55-delete_volume" released by "delete_volume" :: held 4.228s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:47 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info" returned: 0 in 0.403s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info is being set with open permissions: ugo+rw Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:47 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info Nov 03 12:09:47 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-2bc429cf-1b1e-46ca-b756-f5531b61d5d0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-2bc429cf-1b1e-46ca-b756-f5531b61d5d0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:47 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.info" returned: 0 in 0.353s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-85b3c999-880d-4c52-9077-4896d6c5a87a tempest-SnapshotsActionsTest-1157073383 None] Create snapshot completed successfully Nov 03 12:09:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddf4337-336a-49ba-91fc-6fd875655325]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:48 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 Nov 03 12:09:48 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:48 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:48 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0 Nov 03 12:09:48 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:48 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-quobyte-2bc429cf-1b1e-46ca-b756-f5531b61d5d0" released by "delete_volume" :: held 0.803s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Created reservations ['24f07d80-018a-4ed9-9d27-3ba52704f76d', 'eb5db8c3-dfdd-4832-b8c3-5fd31ee2c6a9', '94ff5d92-88ae-4d24-80bc-2c944d2a57de', '702e92ab-77e5-4690-8270-ae4eaa772753'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:48 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:48 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:49 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.333s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:09:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Deleted volume successfully. Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=117,cinder:SELECT=97,cinder:DELETE=9,cinder:INSERT=27 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3691c67e-d6e6-404f-b440-ab21de4198d7 tempest-VolumesDeleteCascade-1676954144 None] Lock "cinder-2bc429cf-1b1e-46ca-b756-f5531b61d5d0-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Creating offline snapshot 8faf2d83-f34b-4e2a-a946-97097beeac2c of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa846d90-71d8-4dab-8c58-5afac6e4c14b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:49 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:49 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:50 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:50 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c 1G Nov 03 12:09:50 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:50 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c 1G" returned: 0 in 0.658s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:50 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c Nov 03 12:09:50 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:51 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:51 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c is being set with open permissions: ugo+rw Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:51 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c Nov 03 12:09:51 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:51 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c" returned: 0 in 0.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d861c868-2af0-4d06-a0ad-91e08567d538 tempest-SnapshotsActionsTest-1157073383 None] Create snapshot completed successfully Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-8faf2d83-f34b-4e2a-a946-97097beeac2c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-8faf2d83-f34b-4e2a-a946-97097beeac2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-8faf2d83-f34b-4e2a-a946-97097beeac2c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-8faf2d83-f34b-4e2a-a946-97097beeac2c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Deleting offline snapshot 8faf2d83-f34b-4e2a-a946-97097beeac2c of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] snapshot_file for this snap is: volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d3a7b-675b-4243-b971-716a539192fe]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:52 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c Nov 03 12:09:52 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:52 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c" returned: 0 in 0.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3418bc-14f8-4a69-857c-74d88f5085dd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:52 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:52 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:53 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.650s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:53 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c Nov 03 12:09:53 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:53 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c" returned: 0 in 0.497s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:53 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c Nov 03 12:09:53 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:54 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.8faf2d83-f34b-4e2a-a946-97097beeac2c" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-8faf2d83-f34b-4e2a-a946-97097beeac2c" released by "_delete_snapshot" :: held 2.088s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_snapshot" :: held 2.121s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Created reservations ['3f603eaa-6d18-4c2c-907e-4a3b78f3ac09', '2ad7c25c-ae8a-49a0-bebd-3f48a7148027', '1cbc7c09-f6fb-4019-8199-4aaea7fef2c5', '04fcfc9a-365d-43d0-b28f-c9fa0c5f7805'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Delete snapshot completed successfully. Nov 03 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-062a5523-c3e9-43db-b467-756e91ae6a96 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-8faf2d83-f34b-4e2a-a946-97097beeac2c-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Flow 'volume_create_manager' (fc5ab325-e3e7-46f2-9f75-0e9901172ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8374ef84-fbba-4d4b-8cb2-38784be3db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8374ef84-fbba-4d4b-8cb2-38784be3db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1243431142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f1449e-e27b-4f02-8b09-764c431b57da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7655854881b848a29e5a868f8cf8588e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:55Z,use_quota=True,user_id='8edb247bcae341eba9b4885f710f9ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4481f416-5670-4e49-88e7-cff2c475b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4481f416-5670-4e49-88e7-cff2c475b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce86bd5-f884-4ea1-8fe9-9acfd7841be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce86bd5-f884-4ea1-8fe9-9acfd7841be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f1449e-e27b-4f02-8b09-764c431b57da', 'volume_name': 'volume-e0f1449e-e27b-4f02-8b09-764c431b57da', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f542037-a6f0-4395-ad7b-d931c696fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f542037-a6f0-4395-ad7b-d931c696fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1497aff2-5be4-4484-9ca5-e6048c429cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Volume e0f1449e-e27b-4f02-8b09-764c431b57da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f1449e-e27b-4f02-8b09-764c431b57da', 'volume_size': 1} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1243431142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f1449e-e27b-4f02-8b09-764c431b57da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7655854881b848a29e5a868f8cf8588e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:09:55Z,use_quota=True,user_id='8edb247bcae341eba9b4885f710f9ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Creating volume e0f1449e-e27b-4f02-8b09-764c431b57da {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:09:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:55 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da 1073741824 Nov 03 12:09:55 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:56 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da 1073741824" returned: 0 in 0.535s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:56 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da Nov 03 12:09:56 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:56 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da" returned: 0 in 0.285s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1497aff2-5be4-4484-9ca5-e6048c429cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f1449e-e27b-4f02-8b09-764c431b57da', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa2fe1-830d-4950-a665-27d456ec8039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Creating offline snapshot 3a3723a9-d0f9-4be1-9854-ff336ecdaac3 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:09:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Volume volume-e0f1449e-e27b-4f02-8b09-764c431b57da (e0f1449e-e27b-4f02-8b09-764c431b57da): created successfully Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa2fe1-830d-4950-a665-27d456ec8039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Flow 'volume_create_manager' (fc5ab325-e3e7-46f2-9f75-0e9901172ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8053004-e564-45dc-897a-9ad14d0fbbbb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a08ab6a9-b414-4325-8dd9-d9c28b3fce1c tempest-VolumesMetadataTest-1981080381 None] Created volume successfully. Nov 03 12:09:56 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:56 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:56 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:56 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 1G Nov 03 12:09:56 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:57 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 1G" returned: 0 in 0.569s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:57 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 Nov 03 12:09:57 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:57 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3" returned: 0 in 0.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:57 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 is being set with open permissions: ugo+rw Nov 03 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:57 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 Nov 03 12:09:57 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:58 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3" returned: 0 in 0.342s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-57489b72-839d-4431-b903-a08a0799fe50 tempest-SnapshotsActionsTest-1157073383 None] Create snapshot completed successfully Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Acquiring lock "cinder-e0f1449e-e27b-4f02-8b09-764c431b57da-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "cinder-e0f1449e-e27b-4f02-8b09-764c431b57da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Acquiring lock "cinder-quobyte-e0f1449e-e27b-4f02-8b09-764c431b57da" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "cinder-quobyte-e0f1449e-e27b-4f02-8b09-764c431b57da" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb0ef65-f220-498b-8f2b-2dad4d7a997e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:58 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da Nov 03 12:09:58 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-3a3723a9-d0f9-4be1-9854-ff336ecdaac3-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-3a3723a9-d0f9-4be1-9854-ff336ecdaac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-3a3723a9-d0f9-4be1-9854-ff336ecdaac3" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-3a3723a9-d0f9-4be1-9854-ff336ecdaac3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Deleting offline snapshot 3a3723a9-d0f9-4be1-9854-ff336ecdaac3 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] snapshot_file for this snap is: volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c49983-a9a1-4ea1-936d-54415e2d7a80]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:59 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 Nov 03 12:09:59 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:59 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da" returned: 0 in 0.520s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:59 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da Nov 03 12:09:59 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:59 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3" returned: 0 in 0.496s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:09:59 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0f1449e-e27b-4f02-8b09-764c431b57da" returned: 0 in 0.336s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "cinder-quobyte-e0f1449e-e27b-4f02-8b09-764c431b57da" released by "delete_volume" :: held 0.919s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feed431-decc-4ada-88f9-56f03f5fbe8c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Created reservations ['95ae96ab-a5ff-4141-8f4a-43e7714b3e7a', '0e276eee-1178-4378-a6ff-f66c536d9b69', '71ea01cf-14a7-4200-907a-ed65bc3da504', 'b6694f4d-76f0-4cca-80b5-e0876005854b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:09:59 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:09:59 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:09:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:09:59 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:09:59 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:00 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.532s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:00 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 Nov 03 12:10:00 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:00 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Deleted volume successfully. Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbf982e0-7151-4bf5-9334-695c68902559 tempest-VolumesMetadataTest-1981080381 None] Lock "cinder-e0f1449e-e27b-4f02-8b09-764c431b57da-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:00 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3" returned: 0 in 0.532s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:00 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3 Nov 03 12:10:00 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:01 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.3a3723a9-d0f9-4be1-9854-ff336ecdaac3" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-3a3723a9-d0f9-4be1-9854-ff336ecdaac3" released by "_delete_snapshot" :: held 2.149s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_snapshot" :: held 2.186s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:01 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Created reservations ['deb3e859-09e4-49ec-b62e-fa8aaa4e1b3d', '7ade455d-7abd-415b-9b76-babb333ded4f', '7bd02575-3e54-4a83-aa00-4b3d2f7cf21e', '04ce59ac-de0e-4353-91a1-e555158806fb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Delete snapshot completed successfully. Nov 03 12:10:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da7f3a9e-604a-440d-9320-6ca9787669c0 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-3a3723a9-d0f9-4be1-9854-ff336ecdaac3-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Creating offline snapshot 7f8ba9c0-e544-4c39-84df-591230c47bd1 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:10:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ce568-2203-4465-b55e-13f8fc419a0c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:02 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:02 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:03 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:03 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 1G Nov 03 12:10:03 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:04 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 1G" returned: 0 in 0.912s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:04 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 Nov 03 12:10:04 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:04 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1" returned: 0 in 0.676s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 is being set with open permissions: ugo+rw Nov 03 12:10:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:04 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 Nov 03 12:10:04 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:05 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1" returned: 0 in 0.539s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c2152436-fa21-4ace-abcc-7baa8afc50eb tempest-SnapshotsActionsTest-1157073383 None] Create snapshot completed successfully Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-7f8ba9c0-e544-4c39-84df-591230c47bd1-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-7f8ba9c0-e544-4c39-84df-591230c47bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-7f8ba9c0-e544-4c39-84df-591230c47bd1" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-7f8ba9c0-e544-4c39-84df-591230c47bd1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Deleting offline snapshot 7f8ba9c0-e544-4c39-84df-591230c47bd1 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] snapshot_file for this snap is: volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f233b97c-4fa7-45e6-b789-a1d73f3c5dee]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:06 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 Nov 03 12:10:06 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:06 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1" returned: 0 in 0.678s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b934c10-e165-42b7-a9a1-b51bd635886a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:07 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:07 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:07 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.697s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:07 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 Nov 03 12:10:07 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:08 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1" returned: 0 in 0.646s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:08 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1 Nov 03 12:10:08 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:08 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.7f8ba9c0-e544-4c39-84df-591230c47bd1" returned: 0 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-7f8ba9c0-e544-4c39-84df-591230c47bd1" released by "_delete_snapshot" :: held 2.561s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_snapshot" :: held 2.610s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Created reservations ['e675b20b-ab3d-4fef-84d6-b894e91e7eb4', '17766588-7d89-4b43-ae61-f6cbb3c030b0', 'f1be3357-4c03-4b8d-94a6-730f85765e73', '50899dd0-0f8a-4716-9e70-ef5fd26c478f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Delete snapshot completed successfully. Nov 03 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e2e98026-bcaf-4227-aaa5-db6adfc25a9f tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-7f8ba9c0-e544-4c39-84df-591230c47bd1-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Creating offline snapshot 70f499e6-7d1f-49ab-a141-e71b983a47b5 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7fdf6e-75d8-4f11-92cb-8aa3c50fbfe9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:10 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:10 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:10 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.553s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:10 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 1G Nov 03 12:10:10 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Flow 'volume_create_manager' (4026d28a-fd5a-4560-aa2b-0d8d5d443ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd704197-0be2-4c94-bdcf-054f4abde777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd704197-0be2-4c94-bdcf-054f4abde777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2135897604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc05cb-8c49-4d1f-b930-f819192201a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fa3753ca2f4b2fbf4f9c3e7ba2ac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:11Z,use_quota=True,user_id='c4ba6981949a43259f7193dbedd1c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7ed8e6-8cc0-425f-81a4-5d3e842da464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7ed8e6-8cc0-425f-81a4-5d3e842da464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6add3-0770-45c1-906c-255355486932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6add3-0770-45c1-906c-255355486932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddc05cb-8c49-4d1f-b930-f819192201a7', 'volume_name': 'volume-6ddc05cb-8c49-4d1f-b930-f819192201a7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4da265f-875a-4c05-a21d-6412055edd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4da265f-875a-4c05-a21d-6412055edd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0881ff2d-dd39-458a-905d-a97253ac4dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Volume 6ddc05cb-8c49-4d1f-b930-f819192201a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddc05cb-8c49-4d1f-b930-f819192201a7', 'volume_size': 1} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:11 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 1G" returned: 0 in 0.777s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:11 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 Nov 03 12:10:11 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:11 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5" returned: 0 in 0.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 is being set with open permissions: ugo+rw Nov 03 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:11 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 Nov 03 12:10:11 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:12 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5" returned: 0 in 0.287s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2135897604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc05cb-8c49-4d1f-b930-f819192201a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fa3753ca2f4b2fbf4f9c3e7ba2ac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:11Z,use_quota=True,user_id='c4ba6981949a43259f7193dbedd1c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Creating volume 6ddc05cb-8c49-4d1f-b930-f819192201a7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:10:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:12 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 1073741824 Nov 03 12:10:12 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-43c89fa0-c8ae-4657-8c7e-85f660bc0156 tempest-SnapshotsActionsTest-1157073383 None] Create snapshot completed successfully Nov 03 12:10:12 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 1073741824" returned: 0 in 0.510s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:12 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 Nov 03 12:10:12 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:12 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0881ff2d-dd39-458a-905d-a97253ac4dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddc05cb-8c49-4d1f-b930-f819192201a7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35627572-c243-4bf6-963a-1cd1d903012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Volume volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 (6ddc05cb-8c49-4d1f-b930-f819192201a7): created successfully Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35627572-c243-4bf6-963a-1cd1d903012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Flow 'volume_create_manager' (4026d28a-fd5a-4560-aa2b-0d8d5d443ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e9f2f62-c2aa-4c5a-b5df-ee2055f96f7d tempest-VolumesTransfersTest-1029758764 None] Created volume successfully. Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-70f499e6-7d1f-49ab-a141-e71b983a47b5-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-70f499e6-7d1f-49ab-a141-e71b983a47b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Acquiring lock "cinder-quobyte-70f499e6-7d1f-49ab-a141-e71b983a47b5" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-70f499e6-7d1f-49ab-a141-e71b983a47b5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Deleting offline snapshot 70f499e6-7d1f-49ab-a141-e71b983a47b5 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] snapshot_file for this snap is: volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe28dac-dec7-4679-aa92-5b17e5059f29]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:13 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 Nov 03 12:10:13 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:13 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5" returned: 0 in 0.436s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[941c6953-53ea-4e4c-9f4b-68f1525d9715]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:14 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:14 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:14 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.549s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9b0b0ae5-3d42-49ba-98bd-b00541149959 tempest-VolumesTransfersTest-178841548 None] Transfer volume completed successfully. Nov 03 12:10:14 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 Nov 03 12:10:14 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:15 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5" returned: 0 in 0.582s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:15 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5 Nov 03 12:10:15 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:15 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "cinder-6ddc05cb-8c49-4d1f-b930-f819192201a7-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.70f499e6-7d1f-49ab-a141-e71b983a47b5" returned: 0 in 0.342s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-70f499e6-7d1f-49ab-a141-e71b983a47b5" released by "_delete_snapshot" :: held 2.083s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-6ddc05cb-8c49-4d1f-b930-f819192201a7-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_snapshot" :: held 2.138s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "cinder-quobyte-6ddc05cb-8c49-4d1f-b930-f819192201a7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-quobyte-6ddc05cb-8c49-4d1f-b930-f819192201a7" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bafa0-f668-4c81-889f-b9dc73dbfcff]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Created reservations ['e09544bd-105d-4718-8e9d-d10645ae463c', '9f2f1a97-6d13-45be-98d0-bb86c0c05a99', 'ae8ceecf-9ef6-4fc2-bb84-db9139f52d83', '0ecd7734-ac19-4157-ba8d-8885caa3439a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Delete snapshot completed successfully. Nov 03 12:10:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b41ccb5-e8f9-4221-a3be-1029589ee337 tempest-SnapshotsActionsTest-1875164500 None] Lock "cinder-70f499e6-7d1f-49ab-a141-e71b983a47b5-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:15 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 Nov 03 12:10:15 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:16 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:16 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7 Nov 03 12:10:16 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:16 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6ddc05cb-8c49-4d1f-b930-f819192201a7" returned: 0 in 0.328s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-quobyte-6ddc05cb-8c49-4d1f-b930-f819192201a7" released by "delete_volume" :: held 0.832s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Created reservations ['3ca8675b-4fd1-4d94-8bd0-a23b91b69a55', 'e569faf5-6a81-4663-855b-6e35df410abe', '73b9a7f6-8e60-4813-a04a-3cf195af8280', 'bfab87b0-1332-4db0-bd58-bfb7840410e4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:16 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:10:16 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:17 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Deleted volume successfully. Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58560f4d-3806-4b0c-a9da-7fe6e262ee78 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-6ddc05cb-8c49-4d1f-b930-f819192201a7-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Flow 'volume_create_manager' (7cfce2ef-51be-46da-ac6f-aac662c94aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4febb6f6-cf5c-474f-8c44-5fe0ef0311e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "cinder-2e09233f-2e35-4e61-a296-b03c33c7cfd4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4febb6f6-cf5c-474f-8c44-5fe0ef0311e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594671418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f154360-c527-4a93-b7b4-3dcdd95cb579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fa3753ca2f4b2fbf4f9c3e7ba2ac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:18Z,use_quota=True,user_id='c4ba6981949a43259f7193dbedd1c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917f3372-a320-4e4b-a5c1-70d92a936f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917f3372-a320-4e4b-a5c1-70d92a936f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826b1eb0-2efa-43dc-b9ec-37ff7d14eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826b1eb0-2efa-43dc-b9ec-37ff7d14eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f154360-c527-4a93-b7b4-3dcdd95cb579', 'volume_name': 'volume-9f154360-c527-4a93-b7b4-3dcdd95cb579', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c963c2-1ae1-4ead-b92a-c1891fac918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c963c2-1ae1-4ead-b92a-c1891fac918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c42fb2-45ec-4a37-ae95-227024f3ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Volume 9f154360-c527-4a93-b7b4-3dcdd95cb579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f154360-c527-4a93-b7b4-3dcdd95cb579', 'volume_size': 1} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594671418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f154360-c527-4a93-b7b4-3dcdd95cb579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fa3753ca2f4b2fbf4f9c3e7ba2ac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:18Z,use_quota=True,user_id='c4ba6981949a43259f7193dbedd1c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Creating volume 9f154360-c527-4a93-b7b4-3dcdd95cb579 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:10:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-2e09233f-2e35-4e61-a296-b03c33c7cfd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "cinder-quobyte-2e09233f-2e35-4e61-a296-b03c33c7cfd4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:17 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 1073741824 Nov 03 12:10:17 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-2e09233f-2e35-4e61-a296-b03c33c7cfd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Deleting offline snapshot 2e09233f-2e35-4e61-a296-b03c33c7cfd4 of volume 874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] snapshot_file for this snap is: volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d81ccc8-87e7-4a98-832d-98a811a6eead]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:17 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:17 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:18 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:18 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 1073741824" returned: 0 in 0.598s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.495s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e9176-a0e9-421e-831a-3f75e9a92f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3165dba-af26-4f2d-853b-9d424a54b344]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:18 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 Nov 03 12:10:18 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:18 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 Nov 03 12:10:18 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:18 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579" returned: 0 in 0.333s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c42fb2-45ec-4a37-ae95-227024f3ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f154360-c527-4a93-b7b4-3dcdd95cb579', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3e42bb-f31d-47d2-84d6-6ca3a522fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Volume volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 (9f154360-c527-4a93-b7b4-3dcdd95cb579): created successfully Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3e42bb-f31d-47d2-84d6-6ca3a522fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Flow 'volume_create_manager' (7cfce2ef-51be-46da-ac6f-aac662c94aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-377b36aa-fdd6-4ec0-928e-87de01f2d82f tempest-VolumesTransfersTest-1029758764 None] Created volume successfully. Nov 03 12:10:18 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:18 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:18 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:19 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.346s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:19 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4 Nov 03 12:10:19 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:19 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90.2e09233f-2e35-4e61-a296-b03c33c7cfd4" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-2e09233f-2e35-4e61-a296-b03c33c7cfd4" released by "_delete_snapshot" :: held 1.703s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_snapshot" :: held 1.730s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Created reservations ['321d765b-2a4b-4f79-9bac-aba7962020d5', '1e087d04-d040-4e4d-b711-f8ffce807266', '34f3ac37-7aee-4515-831f-4110a83da933', '4ef07f45-9b36-4815-99a5-fae0b464f3a4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Delete snapshot completed successfully. Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-57217fba-7314-4a5f-b401-2586d6289b4b tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-2e09233f-2e35-4e61-a296-b03c33c7cfd4-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "cinder-874e9176-a0e9-421e-831a-3f75e9a92f90-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5e3a58df-6916-44d3-b6c0-2acb08827be2 tempest-GroupsV320Test-549162199 None] Group tempest-GroupsV320Test-Group-850047052: creating Nov 03 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-874e9176-a0e9-421e-831a-3f75e9a92f90-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5e3a58df-6916-44d3-b6c0-2acb08827be2 tempest-GroupsV320Test-549162199 None] Group tempest-GroupsV320Test-Group-850047052: created successfully Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "cinder-9f154360-c527-4a93-b7b4-3dcdd95cb579-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5e3a58df-6916-44d3-b6c0-2acb08827be2 tempest-GroupsV320Test-549162199 None] Create group completed successfully. Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-9f154360-c527-4a93-b7b4-3dcdd95cb579-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e8989f-8958-47ce-a621-bfac0a6824a1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "cinder-quobyte-9f154360-c527-4a93-b7b4-3dcdd95cb579" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-quobyte-9f154360-c527-4a93-b7b4-3dcdd95cb579" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf61c0-a21d-4a57-a0ae-059ed12d1778]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:20 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 Nov 03 12:10:20 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:20 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 Nov 03 12:10:20 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:20 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90" returned: 0 in 0.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:20 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90 Nov 03 12:10:20 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:20 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:20 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579 Nov 03 12:10:20 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:20 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-874e9176-a0e9-421e-831a-3f75e9a92f90" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-quobyte-874e9176-a0e9-421e-831a-3f75e9a92f90" released by "delete_volume" :: held 0.677s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Created reservations ['4ae743fc-cc09-47f1-9c48-323e454ecf50', '3960fb8d-2726-476b-8267-ab236c4a6dcb', 'f1cd971c-0fe2-4e61-8686-3786a4bd4d0a', 'c506f2fd-4c0d-4ce5-89b9-8058b73f2e44'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:20 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f154360-c527-4a93-b7b4-3dcdd95cb579" returned: 0 in 0.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-quobyte-9f154360-c527-4a93-b7b4-3dcdd95cb579" released by "delete_volume" :: held 0.694s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:20 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:10:20 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Created reservations ['06090388-5afd-41e4-b1bf-4189b02cb87a', '12da95de-bd7e-4d61-98cb-299d3f15f9b8', '8045bff0-fb99-42f7-a71e-08ae301c396e', '153643a1-275a-40c5-ab41-819b3506f18a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:21 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:10:21 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:21 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.328s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Deleted volume successfully. Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5b3e932-7235-481f-a700-99401c708ef7 tempest-SnapshotsActionsTest-1157073383 None] Lock "cinder-874e9176-a0e9-421e-831a-3f75e9a92f90-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:21 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Deleted volume successfully. Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0506c020-0968-4c20-a243-f06daafda401 tempest-VolumesTransfersTest-27987441 None] Lock "cinder-9f154360-c527-4a93-b7b4-3dcdd95cb579-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Created reservations ['10806a95-2338-437f-9b9f-c6dbc4cad9c4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:21 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:10:21 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:22 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.272s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7cd80ed6-0752-4bc2-8b42-0f308aa1bf22 tempest-GroupsV320Test-549162199 None] Delete group completed successfully. Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:24 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:10:24 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:24 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.271s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:10:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=111,cinder:DELETE=9,cinder:SELECT=85,cinder:INSERT=26 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:10:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=70,cinder:SELECT=67,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Flow 'volume_create_manager' (d0d1a5d5-9193-4ded-81c1-303850bddee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70972375-3fee-496b-b8eb-4626012e85c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70972375-3fee-496b-b8eb-4626012e85c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1626693924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306297d9-6773-4a60-83ca-65825b79e083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa10652d364b83bf97be1b07f5d19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:32Z,use_quota=True,user_id='adab27cc3a134a10baf42a212dc4534e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661bcb06-c54d-4887-8168-ad36122a35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661bcb06-c54d-4887-8168-ad36122a35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f38fee-a863-4d8b-af8a-fe6911ca94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f38fee-a863-4d8b-af8a-fe6911ca94e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306297d9-6773-4a60-83ca-65825b79e083', 'volume_name': 'volume-306297d9-6773-4a60-83ca-65825b79e083', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a09b2-d729-43d0-8bf0-1317656751c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a09b2-d729-43d0-8bf0-1317656751c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc27439-94b7-4c3d-bf5a-f27692527fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Volume 306297d9-6773-4a60-83ca-65825b79e083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306297d9-6773-4a60-83ca-65825b79e083', 'volume_size': 1} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1626693924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306297d9-6773-4a60-83ca-65825b79e083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa10652d364b83bf97be1b07f5d19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:32Z,use_quota=True,user_id='adab27cc3a134a10baf42a212dc4534e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Creating volume 306297d9-6773-4a60-83ca-65825b79e083 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:10:32 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:32 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 1073741824 Nov 03 12:10:32 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:33 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 1073741824" returned: 0 in 0.609s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:33 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 Nov 03 12:10:33 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:33 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083" returned: 0 in 0.438s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc27439-94b7-4c3d-bf5a-f27692527fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306297d9-6773-4a60-83ca-65825b79e083', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9908bcd-2375-4fd0-b505-2774398a12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Volume volume-306297d9-6773-4a60-83ca-65825b79e083 (306297d9-6773-4a60-83ca-65825b79e083): created successfully Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9908bcd-2375-4fd0-b505-2774398a12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Flow 'volume_create_manager' (d0d1a5d5-9193-4ded-81c1-303850bddee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-be1a4137-d88c-4823-8908-fbe070d71452 tempest-AttachVolumeShelveTestJSON-761629616 None] Created volume successfully. Nov 03 12:10:43 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:10:43 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Flow 'volume_create_manager' (1061bcb4-d27d-41bf-8225-6bd52183d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c45325-632b-4ec3-a1ab-26c6aca5caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c45325-632b-4ec3-a1ab-26c6aca5caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823352960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9585f618-8d72-4f18-be7e-182500576d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7832bc7eaf94c5e8943e7fcf52b1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:47Z,use_quota=True,user_id='5692a179a26146fa9fc2b2b376850327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fa3a55-d65c-40f7-abac-9bf4aedecc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fa3a55-d65c-40f7-abac-9bf4aedecc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145877e7-b6a4-4964-be85-f6fdf554602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145877e7-b6a4-4964-be85-f6fdf554602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9585f618-8d72-4f18-be7e-182500576d07', 'volume_name': 'volume-9585f618-8d72-4f18-be7e-182500576d07', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4d8ccf-eaf3-4b32-8606-50a8e02fa68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4d8ccf-eaf3-4b32-8606-50a8e02fa68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243c2e1-8620-4f92-be2c-c9866d8ceda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Volume 9585f618-8d72-4f18-be7e-182500576d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9585f618-8d72-4f18-be7e-182500576d07', 'volume_size': 1} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823352960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9585f618-8d72-4f18-be7e-182500576d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7832bc7eaf94c5e8943e7fcf52b1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:10:47Z,use_quota=True,user_id='5692a179a26146fa9fc2b2b376850327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Creating volume 9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:10:47 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:47 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 1073741824 Nov 03 12:10:47 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:47 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 1073741824" returned: 0 in 0.595s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:10:48 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:10:48 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:10:48 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243c2e1-8620-4f92-be2c-c9866d8ceda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9585f618-8d72-4f18-be7e-182500576d07', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062c9ec7-7617-409e-aeb4-cbb15bcea425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:10:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Volume volume-9585f618-8d72-4f18-be7e-182500576d07 (9585f618-8d72-4f18-be7e-182500576d07): created successfully Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062c9ec7-7617-409e-aeb4-cbb15bcea425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:10:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Flow 'volume_create_manager' (1061bcb4-d27d-41bf-8225-6bd52183d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:10:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c2274cb8-bf14-491f-ba0a-96043066c117 tempest-VolumesActionsTest-344910984 None] Created volume successfully. Nov 03 12:10:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-ff39994a-924e-454d-8d05-a945cb69ba9a req-1092c522-0b8b-4a69-a9b1-8e06c3f521a7 tempest-AttachVolumeShelveTestJSON-761629616 None] No connector for attachment 03857312-6ef2-40c7-897d-b2cca0d25579; skipping storage backend terminate_connection call. {{(pid=86561) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 12:10:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-ff39994a-924e-454d-8d05-a945cb69ba9a req-1092c522-0b8b-4a69-a9b1-8e06c3f521a7 tempest-AttachVolumeShelveTestJSON-761629616 None] Deleting attachment 03857312-6ef2-40c7-897d-b2cca0d25579. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:11:03 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:03 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43cbf39b-5297-43b3-8815-754cc084efb5 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43cbf39b-5297-43b3-8815-754cc084efb5 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" acquired by "attach_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-43cbf39b-5297-43b3-8815-754cc084efb5 tempest-VolumesActionsTest-344910984 None] Attaching volume 9585f618-8d72-4f18-be7e-182500576d07 to instance 77d14f20-d241-4976-8666-d2ca03b3738c at mountpoint /dev/vdb on host None. Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-43cbf39b-5297-43b3-8815-754cc084efb5 tempest-VolumesActionsTest-344910984 None] Attach volume completed successfully. Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43cbf39b-5297-43b3-8815-754cc084efb5 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" released by "attach_volume" :: held 0.298s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Flow 'volume_create_manager' (a184aa79-c4ab-4e72-941d-dd62307fa113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d968aac-c48c-4e75-8b16-087063f2a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f6876b4-c315-4a34-8c77-9235315caa87 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d968aac-c48c-4e75-8b16-087063f2a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-957761030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d7d3ab6ebb4a7fb08f6652325423e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:05Z,use_quota=True,user_id='4b655afdeec3411692378ea431d7f2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92e4d5f-7b6f-48af-ae29-c41b989064a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92e4d5f-7b6f-48af-ae29-c41b989064a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ce4918-df2e-4beb-ab4d-80b2db3fab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ce4918-df2e-4beb-ab4d-80b2db3fab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb', 'volume_name': 'volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a953a2-b873-4f78-a862-a6b58b780d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a953a2-b873-4f78-a862-a6b58b780d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6c0db-e591-4cd8-96d6-61b05fba9986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Volume 8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb', 'volume_size': 1} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-957761030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d7d3ab6ebb4a7fb08f6652325423e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:05Z,use_quota=True,user_id='4b655afdeec3411692378ea431d7f2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Creating volume 8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f6876b4-c315-4a34-8c77-9235315caa87 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" acquired by "detach_volume" :: waited 0.148s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5f6876b4-c315-4a34-8c77-9235315caa87 tempest-VolumesActionsTest-344910984 None] Detaching volume 9585f618-8d72-4f18-be7e-182500576d07 from instance 77d14f20-d241-4976-8666-d2ca03b3738c. Nov 03 12:11:05 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb 1073741824 Nov 03 12:11:05 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5f6876b4-c315-4a34-8c77-9235315caa87 tempest-VolumesActionsTest-344910984 None] Detach volume completed successfully. Nov 03 12:11:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f6876b4-c315-4a34-8c77-9235315caa87 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" released by "detach_volume" :: held 0.187s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:06 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb 1073741824" returned: 0 in 1.021s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:06 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb Nov 03 12:11:06 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:07 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" returned: 0 in 0.411s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6c0db-e591-4cd8-96d6-61b05fba9986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ac4e60-24b2-4228-bb44-2862a5ec0c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Volume volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb (8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb): created successfully Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ac4e60-24b2-4228-bb44-2862a5ec0c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Flow 'volume_create_manager' (a184aa79-c4ab-4e72-941d-dd62307fa113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b62838ee-d41d-4772-9189-22c00c5478f0 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Created volume successfully. Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Acquiring lock "cinder-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "cinder-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Acquiring lock "cinder-quobyte-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "cinder-quobyte-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1afab0d-63bc-4aa4-bf79-d4bc991def8f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:10 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb Nov 03 12:11:10 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:10 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" returned: 0 in 0.429s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:10 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb Nov 03 12:11:10 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:10 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "cinder-quobyte-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb" released by "delete_volume" :: held 0.803s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Created reservations ['0bc77679-7c33-4a67-8dc1-5d8e2ade1432', 'ba332596-c2b9-42cd-b753-60ec06169e74', 'a3f2bde2-1d08-42b0-bf28-e5ba39c2b2d2', 'c9b32c95-20ad-497b-9b2f-ea5009fc59cb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:10 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:11:10 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:11 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.370s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:11:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Deleted volume successfully. Nov 03 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af37258d-f345-4222-8eff-91a721b83f21 tempest-VolumeQuotasNegativeTestJSON-1583550855 None] Lock "cinder-8b3c4118-096f-46ac-bc0a-76ec4b8ff2bb-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:20 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:21 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:INSERT=4,cinder:SELECT=15,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (7434c00c-d5ee-4867-bcd0-1d3a73244da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92227e8f-1954-4771-9848-55e644e6a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92227e8f-1954-4771-9848-55e644e6a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27402804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3181784a-2816-4871-a34f-c1ba49f0531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:23Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6e3c38-2bfa-40f4-b146-b8745a12a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6e3c38-2bfa-40f4-b146-b8745a12a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8111d75b-5c40-4633-8080-35d95b1c831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8111d75b-5c40-4633-8080-35d95b1c831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3181784a-2816-4871-a34f-c1ba49f0531c', 'volume_name': 'volume-3181784a-2816-4871-a34f-c1ba49f0531c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8610c83f-442e-429c-afdd-33601d37aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8610c83f-442e-429c-afdd-33601d37aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a4fecb-97a8-46ab-ae41-2267f07d3ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Volume 3181784a-2816-4871-a34f-c1ba49f0531c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3181784a-2816-4871-a34f-c1ba49f0531c', 'volume_size': 1} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27402804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3181784a-2816-4871-a34f-c1ba49f0531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:23Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Creating volume 3181784a-2816-4871-a34f-c1ba49f0531c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:11:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:23 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c 1073741824 Nov 03 12:11:23 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:24 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:11:24 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:24 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c 1073741824" returned: 0 in 1.109s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:24 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c Nov 03 12:11:24 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:24 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:11:25 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c" returned: 0 in 0.533s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a4fecb-97a8-46ab-ae41-2267f07d3ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3181784a-2816-4871-a34f-c1ba49f0531c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096426e3-141e-42d3-a947-f07f050d30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Volume volume-3181784a-2816-4871-a34f-c1ba49f0531c (3181784a-2816-4871-a34f-c1ba49f0531c): created successfully Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096426e3-141e-42d3-a947-f07f050d30a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (7434c00c-d5ee-4867-bcd0-1d3a73244da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-044a92cc-e610-43c7-a344-8f26fcc9f46f tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cfe26ce-26fb-4661-892f-192e05920f78 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cfe26ce-26fb-4661-892f-192e05920f78 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" acquired by "attach_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3cfe26ce-26fb-4661-892f-192e05920f78 tempest-VolumesActionsTest-344910984 None] Attaching volume 9585f618-8d72-4f18-be7e-182500576d07 to instance 33cf2723-5726-4c77-b088-b5daa2ca9cea at mountpoint /dev/vdb on host None. Nov 03 12:11:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3cfe26ce-26fb-4661-892f-192e05920f78 tempest-VolumesActionsTest-344910984 None] Attach volume completed successfully. Nov 03 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cfe26ce-26fb-4661-892f-192e05920f78 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07" released by "attach_volume" :: held 0.159s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Flow 'volume_create_manager' (a39c1c53-614f-4e12-b365-59cc81a4ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e534fae-f83c-48d0-9b63-acf5072fd8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5af06dc6-40bf-4e8a-9363-d1221a012569 tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e534fae-f83c-48d0-9b63-acf5072fd8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1770703954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e9a075-3076-4ad5-a58f-a2a439a83080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f7058baa484a259092db36e07cfc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:26Z,use_quota=True,user_id='d2a3478dc5914dc9b75b90185755f68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc4b34-2026-4fa5-9c11-c1287af940d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc4b34-2026-4fa5-9c11-c1287af940d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c7b49e-a901-4ad1-81a4-ff20c072f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c7b49e-a901-4ad1-81a4-ff20c072f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e9a075-3076-4ad5-a58f-a2a439a83080', 'volume_name': 'volume-65e9a075-3076-4ad5-a58f-a2a439a83080', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6d4baf-160f-46cf-a647-2d4ccb3f09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6d4baf-160f-46cf-a647-2d4ccb3f09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b979ee8-b4e6-4b79-8367-bc8ee1463efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Volume 65e9a075-3076-4ad5-a58f-a2a439a83080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e9a075-3076-4ad5-a58f-a2a439a83080', 'volume_size': 1} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1770703954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e9a075-3076-4ad5-a58f-a2a439a83080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f7058baa484a259092db36e07cfc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:26Z,use_quota=True,user_id='d2a3478dc5914dc9b75b90185755f68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Creating volume 65e9a075-3076-4ad5-a58f-a2a439a83080 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5af06dc6-40bf-4e8a-9363-d1221a012569 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c" acquired by "attach_volume" :: waited 0.136s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-209d5fcf-cbc9-4e3b-9285-4f96666b3eb8 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:26 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 1073741824 Nov 03 12:11:26 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-209d5fcf-cbc9-4e3b-9285-4f96666b3eb8 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-209d5fcf-cbc9-4e3b-9285-4f96666b3eb8 tempest-VolumesActionsTest-344910984 None] Detaching volume 9585f618-8d72-4f18-be7e-182500576d07 from instance 33cf2723-5726-4c77-b088-b5daa2ca9cea. Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5af06dc6-40bf-4e8a-9363-d1221a012569 tempest-VolumesActionsTest-275650487 None] Attaching volume 3181784a-2816-4871-a34f-c1ba49f0531c to instance d20aaa80-b571-4bab-89b8-f93bfbfc3ea2 at mountpoint /dev/vdb on host None. Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5af06dc6-40bf-4e8a-9363-d1221a012569 tempest-VolumesActionsTest-275650487 None] Attach volume completed successfully. Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5af06dc6-40bf-4e8a-9363-d1221a012569 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c" released by "attach_volume" :: held 0.141s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-209d5fcf-cbc9-4e3b-9285-4f96666b3eb8 tempest-VolumesActionsTest-344910984 None] Detach volume completed successfully. Nov 03 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-209d5fcf-cbc9-4e3b-9285-4f96666b3eb8 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:27 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 1073741824" returned: 0 in 1.135s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:28 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 Nov 03 12:11:28 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Terminate volume connection completed successfully. Nov 03 12:11:28 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080" returned: 0 in 0.754s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b979ee8-b4e6-4b79-8367-bc8ee1463efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e9a075-3076-4ad5-a58f-a2a439a83080', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef682d6-804f-46c5-b1eb-841def0aa209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Volume volume-65e9a075-3076-4ad5-a58f-a2a439a83080 (65e9a075-3076-4ad5-a58f-a2a439a83080): created successfully Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef682d6-804f-46c5-b1eb-841def0aa209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Flow 'volume_create_manager' (a39c1c53-614f-4e12-b365-59cc81a4ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Detaching volume 3181784a-2816-4871-a34f-c1ba49f0531c from instance d20aaa80-b571-4bab-89b8-f93bfbfc3ea2. Nov 03 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f76e4109-02cc-4745-b939-7743d68e2a43 tempest-VolumesServicesTestJSON-836779760 None] Created volume successfully. Nov 03 12:11:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Detach volume completed successfully. Nov 03 12:11:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-752375bd-c93e-4932-8c38-596488955dea tempest-VolumesActionsTest-654695495 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" released by "detach_volume" :: held 0.251s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b4f087d0-dc59-46b5-b960-2b1fb55cbb62 tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b4f087d0-dc59-46b5-b960-2b1fb55cbb62 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b4f087d0-dc59-46b5-b960-2b1fb55cbb62 tempest-VolumesActionsTest-275650487 None] Volume detach called, but volume not attached. Nov 03 12:11:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b4f087d0-dc59-46b5-b960-2b1fb55cbb62 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-quobyte-3181784a-2816-4871-a34f-c1ba49f0531c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "cinder-quobyte-3181784a-2816-4871-a34f-c1ba49f0531c" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b02471-3486-453b-9db1-fc71fee3f9d1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Acquiring lock "cinder-65e9a075-3076-4ad5-a58f-a2a439a83080-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "cinder-65e9a075-3076-4ad5-a58f-a2a439a83080-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Acquiring lock "cinder-quobyte-65e9a075-3076-4ad5-a58f-a2a439a83080" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:30 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c Nov 03 12:11:30 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "cinder-quobyte-65e9a075-3076-4ad5-a58f-a2a439a83080" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5fc10-5bec-47c7-ac00-355864170ec4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:30 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 Nov 03 12:11:30 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:31 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c" returned: 0 in 0.738s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:31 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c Nov 03 12:11:31 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:31 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080" returned: 0 in 0.885s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:31 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080 Nov 03 12:11:31 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:31 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3181784a-2816-4871-a34f-c1ba49f0531c" returned: 0 in 0.548s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "cinder-quobyte-3181784a-2816-4871-a34f-c1ba49f0531c" released by "delete_volume" :: held 1.409s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Created reservations ['a22d1a93-3186-41e6-9e95-e105468a9996', '3bf7cc9c-8eb3-4c4f-a0e9-cd81de7c7ce8', '1042f9f1-ae97-4235-bf2d-0af92f4cc259', '89847e24-fbfd-4c74-b31b-1787536ca83e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:31 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:11:31 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:31 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-65e9a075-3076-4ad5-a58f-a2a439a83080" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "cinder-quobyte-65e9a075-3076-4ad5-a58f-a2a439a83080" released by "delete_volume" :: held 1.385s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Created reservations ['a64cbe13-d897-4695-84b3-efd318bd0e2f', 'c9b89feb-8547-4b30-8169-cd78830bec7a', '67911cf8-17d6-4eec-8696-682325f4849d', 'b2af752d-23aa-4b2a-b0eb-eb8e308a3f38'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:32 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:11:32 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:32 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:11:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Deleted volume successfully. Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c3891e74-825d-4425-a5ce-a91dc67ff1a6 tempest-VolumesActionsTest-275650487 None] Lock "cinder-3181784a-2816-4871-a34f-c1ba49f0531c-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:32 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.327s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:11:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Deleted volume successfully. Nov 03 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90693503-0498-44af-be15-dbb7c1781311 tempest-VolumesServicesTestJSON-836779760 None] Lock "cinder-65e9a075-3076-4ad5-a58f-a2a439a83080-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:11:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:11:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[87066c71-e073-441d-a3f6-46c84f188ee9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:34 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:11:34 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:34 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.489s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53057708-bf65-41d3-9029-bd1146cdefb9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:34 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:11:34 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:34 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.422s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.38369abf-5d94-4606-a8f7-c1b927d3d3663rawf3_z.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:34 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.38369abf-5d94-4606-a8f7-c1b927d3d3663rawf3_z.img Nov 03 12:11:34 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (6946bad2-1499-4a08-a4ea-6c0e4663c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775138af-199b-4393-8b40-ef5fbd023b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775138af-199b-4393-8b40-ef5fbd023b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243475190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79734f16-e129-464d-a429-7d972f80daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:36Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27348f28-67f9-43ae-9f18-5e9764cf638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27348f28-67f9-43ae-9f18-5e9764cf638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86665fc5-c607-4212-871f-16d5541137c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86665fc5-c607-4212-871f-16d5541137c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79734f16-e129-464d-a429-7d972f80daab', 'volume_name': 'volume-79734f16-e129-464d-a429-7d972f80daab', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc084298-1d48-466a-bf2f-18572a5cfeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc084298-1d48-466a-bf2f-18572a5cfeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4606086d-8292-4a96-b557-a29d0bf0a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Volume 79734f16-e129-464d-a429-7d972f80daab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79734f16-e129-464d-a429-7d972f80daab', 'volume_size': 1} Nov 03 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:42 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.38369abf-5d94-4606-a8f7-c1b927d3d3663rawf3_z.img" returned: 0 in 7.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1409ecb-3be4-4fbc-abd2-fafc0319fed6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:42 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:11:42 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:11:42 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.570s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.38369abf-5d94-4606-a8f7-c1b927d3d3663rawf3_z.img {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:11:42 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Converted 1024.00 MB image at 138.13 MB/s Nov 03 12:11:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] 38369abf-5d94-4606-a8f7-c1b927d3d366 was raw, no need to convert to raw {{(pid=86561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Flow 'volume_create_manager' (8f7f2454-46a3-484e-8486-4c12bc50083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0416f542-fe8f-4260-b723-1fb441f42ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0416f542-fe8f-4260-b723-1fb441f42ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-958381778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374c92c4-2618-4276-943d-95adf74ef6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341471a194954a1b8934d7d738ce6dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:46Z,use_quota=True,user_id='e1b851b35bcc4c718f656de3a9c2d0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c1f75c-b556-4503-b9b6-4df372227e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c1f75c-b556-4503-b9b6-4df372227e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce23da0-b881-46cf-afaa-ac12e312db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce23da0-b881-46cf-afaa-ac12e312db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374c92c4-2618-4276-943d-95adf74ef6cd', 'volume_name': 'volume-374c92c4-2618-4276-943d-95adf74ef6cd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9680c-bf34-425d-a519-da832cbf41b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9680c-bf34-425d-a519-da832cbf41b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f19574-e6c2-48ff-b947-eb8588cfbc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:11:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Volume 374c92c4-2618-4276-943d-95adf74ef6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374c92c4-2618-4276-943d-95adf74ef6cd', 'volume_size': 1} Nov 03 12:11:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:11:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=32,cinder:SELECT=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Acquiring lock "cinder-306297d9-6773-4a60-83ca-65825b79e083-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "cinder-306297d9-6773-4a60-83ca-65825b79e083-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Acquiring lock "cinder-quobyte-306297d9-6773-4a60-83ca-65825b79e083" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "cinder-quobyte-306297d9-6773-4a60-83ca-65825b79e083" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c63d75-f3c9-4a76-a299-f9c9ac1d785a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:11:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:11:59 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 Nov 03 12:11:59 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:00 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083" returned: 0 in 0.418s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:00 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083 Nov 03 12:12:00 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:00 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-306297d9-6773-4a60-83ca-65825b79e083" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "cinder-quobyte-306297d9-6773-4a60-83ca-65825b79e083" released by "delete_volume" :: held 0.748s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Created reservations ['15f1da12-d26e-4d4a-9c4a-a1b57a55163b', '371342b6-0bdd-46b9-acd9-5e2ef6e25f32', '5aab9787-0440-45bf-9e8a-33fd454ae49f', 'f2ae5482-7be8-43d2-a4fd-ae0d3669d972'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:00 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:00 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:00 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.274s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Deleted volume successfully. Nov 03 12:12:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-49d85082-761c-4157-aa7c-18344197e73f tempest-AttachVolumeShelveTestJSON-761629616 None] Lock "cinder-306297d9-6773-4a60-83ca-65825b79e083-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.705s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Uploaded volume to glance image-id: 38369abf-5d94-4606-a8f7-c1b927d3d366. {{(pid=86561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.068s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243475190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79734f16-e129-464d-a429-7d972f80daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:36Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Creating volume 79734f16-e129-464d-a429-7d972f80daab {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:03 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:03 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab 1073741824 Nov 03 12:12:03 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8956f04b-e458-4e84-a744-2db1ea588900 tempest-VolumesActionsTest-344910984 None] Copy volume to image completed successfully. Nov 03 12:12:04 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab 1073741824" returned: 0 in 0.400s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:04 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab Nov 03 12:12:04 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:04 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab" returned: 0 in 0.301s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.129s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-958381778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374c92c4-2618-4276-943d-95adf74ef6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341471a194954a1b8934d7d738ce6dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:11:46Z,use_quota=True,user_id='e1b851b35bcc4c718f656de3a9c2d0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Creating volume 374c92c4-2618-4276-943d-95adf74ef6cd {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:04 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd 1073741824 Nov 03 12:12:04 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4606086d-8292-4a96-b557-a29d0bf0a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79734f16-e129-464d-a429-7d972f80daab', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56bfc09-a8c0-4dd8-9348-f51725c6315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Volume volume-79734f16-e129-464d-a429-7d972f80daab (79734f16-e129-464d-a429-7d972f80daab): created successfully Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56bfc09-a8c0-4dd8-9348-f51725c6315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (6946bad2-1499-4a08-a4ea-6c0e4663c701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-209af591-fc1b-4e87-8fa7-a5586f873700 tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-79734f16-e129-464d-a429-7d972f80daab-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "cinder-79734f16-e129-464d-a429-7d972f80daab-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-quobyte-79734f16-e129-464d-a429-7d972f80daab" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-79734f16-e129-464d-a429-7d972f80daab" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a663c-88f3-41e6-bec7-aa559b5a983b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:05 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd 1073741824" returned: 0 in 0.800s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:05 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab Nov 03 12:12:05 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:05 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd Nov 03 12:12:05 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:05 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f19574-e6c2-48ff-b947-eb8588cfbc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374c92c4-2618-4276-943d-95adf74ef6cd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b08a2d9-47ae-4f51-a02c-ed210b25ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:05 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Volume volume-374c92c4-2618-4276-943d-95adf74ef6cd (374c92c4-2618-4276-943d-95adf74ef6cd): created successfully Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b08a2d9-47ae-4f51-a02c-ed210b25ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Flow 'volume_create_manager' (8f7f2454-46a3-484e-8486-4c12bc50083d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c3502a8a-a3bd-40db-8af9-ffe856fc3517 tempest-AbsoluteLimitsTests-932278759 None] Created volume successfully. Nov 03 12:12:05 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab Nov 03 12:12:05 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:06 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-79734f16-e129-464d-a429-7d972f80daab" returned: 0 in 0.372s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-79734f16-e129-464d-a429-7d972f80daab" released by "delete_volume" :: held 1.139s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Created reservations ['28263008-cdb3-4e91-b5b2-62bce6080d18', '37974da6-8fc6-4ae8-9434-af35a58dff90', '8c5f1870-95c3-49fa-9493-1cab49c5426b', '3cb7c0c1-52ea-44b7-800f-17f6468acbd9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfd6dd5-f3d1-49e8-99dd-00007e0e9a09]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:06 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:06 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:06 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:12:06 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:06 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.392s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Deleted volume successfully. Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a1ccf44-2ca4-48cb-8c1f-60921f57843a tempest-VolumesActionsTest-654695495 None] Lock "cinder-79734f16-e129-464d-a429-7d972f80daab-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:06 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.493s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a2bfdf-734b-4596-9b6e-f92c740485da]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:07 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:12:07 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Acquiring lock "cinder-374c92c4-2618-4276-943d-95adf74ef6cd-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "cinder-374c92c4-2618-4276-943d-95adf74ef6cd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Acquiring lock "cinder-quobyte-374c92c4-2618-4276-943d-95adf74ef6cd" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "cinder-quobyte-374c92c4-2618-4276-943d-95adf74ef6cd" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc61dd-3c1c-40b5-995a-b2576ab78af1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:07 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.639s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:07 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img Nov 03 12:12:07 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:07 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd Nov 03 12:12:07 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (19db8d0e-2490-4ac0-a2bd-41c517fe7021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f4f13-33a8-44d4-a324-4a3500fae3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f4f13-33a8-44d4-a324-4a3500fae3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312365889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d28410-a05e-4979-9c19-ca7e65dad970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:08Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d18d64-789a-4dd2-91f5-119c730ccc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:08 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d18d64-789a-4dd2-91f5-119c730ccc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abad38a0-200c-47d3-9a32-1791c7dde1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abad38a0-200c-47d3-9a32-1791c7dde1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d28410-a05e-4979-9c19-ca7e65dad970', 'volume_name': 'volume-44d28410-a05e-4979-9c19-ca7e65dad970', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08557bca-8b14-4561-90d4-a49e93d1da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08557bca-8b14-4561-90d4-a49e93d1da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7c0058-3c4a-4fb5-86a6-1f6ecd7fe61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Volume 44d28410-a05e-4979-9c19-ca7e65dad970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d28410-a05e-4979-9c19-ca7e65dad970', 'volume_size': 1} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd" returned: 0 in 0.602s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:08 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd Nov 03 12:12:08 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:08 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-374c92c4-2618-4276-943d-95adf74ef6cd" returned: 0 in 0.461s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "cinder-quobyte-374c92c4-2618-4276-943d-95adf74ef6cd" released by "delete_volume" :: held 1.138s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Created reservations ['9550bb90-26a9-4b75-91d8-2fcd2763c304', '2d25f178-3eef-4d49-b01d-6eb1487070a8', '7d9efedb-652e-4fb2-b91e-670e3253cfb6', '0fb3a9f7-7960-4f6e-8447-b88fc78924ae'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:09 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:09 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:09 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Deleted volume successfully. Nov 03 12:12:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-af7f55b3-cd9c-4340-bec2-5503994ce286 tempest-AbsoluteLimitsTests-932278759 None] Lock "cinder-374c92c4-2618-4276-943d-95adf74ef6cd-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:15 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img" returned: 0 in 8.281s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[115817ba-7d63-4e51-99b6-b2c5099f2907]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:16 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:12:16 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:16 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.554s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:12:16 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Converted 1024.00 MB image at 123.64 MB/s Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] c893e2fb-02ce-4e6f-907f-b6b96154e720 was raw, converting to qcow2 {{(pid=86561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[119fac15-c24d-487a-862f-3afa8c70cd94]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:16 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img Nov 03 12:12:16 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:16 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:17 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img Nov 03 12:12:17 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:17 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img" returned: 1 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img /opt/stack/data/cinder/conversion/vol_upload_88ayr94n {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:17 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img /opt/stack/data/cinder/conversion/vol_upload_88ayr94n Nov 03 12:12:17 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:17 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img /opt/stack/data/cinder/conversion/vol_upload_88ayr94n" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Image conversion details: src /opt/stack/data/cinder/conversion/9585f618-8d72-4f18-be7e-182500576d07.temp_image.c893e2fb-02ce-4e6f-907f-b6b96154e720g9w4pst0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_88ayr94n {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:12:17 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[741993e8-be74-4c58-98c6-5ce433599acc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88ayr94n {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:17 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88ayr94n Nov 03 12:12:17 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:18 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88ayr94n" returned: 0 in 0.469s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.461s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Uploaded volume to glance image-id: c893e2fb-02ce-4e6f-907f-b6b96154e720. {{(pid=86561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.714s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312365889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d28410-a05e-4979-9c19-ca7e65dad970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:08Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Creating volume 44d28410-a05e-4979-9c19-ca7e65dad970 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:19 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:19 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 1073741824 Nov 03 12:12:19 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a7f2fe11-4dc0-4544-813a-3e98cf4a2e5c tempest-VolumesActionsTest-344910984 None] Copy volume to image completed successfully. Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Flow 'volume_create_manager' (962875eb-347e-491d-9f64-0f0dd7e35998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5739d0e-8f2c-44c3-930a-375fa9f6e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5739d0e-8f2c-44c3-930a-375fa9f6e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1811592278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a0298-c868-4d1b-ad53-815406077eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9d8a2677224684bb3cd28981ca934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:20Z,use_quota=True,user_id='9f651acabe8344a99140e1d1057f1a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31101774-7be7-4927-b14c-82b7e7a59a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31101774-7be7-4927-b14c-82b7e7a59a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199ffabd-3f2d-4005-b0ed-e046b315e61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199ffabd-3f2d-4005-b0ed-e046b315e61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8a0298-c868-4d1b-ad53-815406077eb3', 'volume_name': 'volume-0c8a0298-c868-4d1b-ad53-815406077eb3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c459e0-0e50-4c89-bb86-bec37614b954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c459e0-0e50-4c89-bb86-bec37614b954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcb175d-3877-4470-8778-b03c0c05ec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Volume 0c8a0298-c868-4d1b-ad53-815406077eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8a0298-c868-4d1b-ad53-815406077eb3', 'volume_size': 1} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:20 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 1073741824" returned: 0 in 0.611s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:20 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 Nov 03 12:12:20 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:20 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1811592278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a0298-c868-4d1b-ad53-815406077eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9d8a2677224684bb3cd28981ca934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:20Z,use_quota=True,user_id='9f651acabe8344a99140e1d1057f1a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Creating volume 0c8a0298-c868-4d1b-ad53-815406077eb3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:20 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7c0058-3c4a-4fb5-86a6-1f6ecd7fe61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d28410-a05e-4979-9c19-ca7e65dad970', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 1073741824 Nov 03 12:12:20 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43f1e8-778b-4b2d-9901-94d71270bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Volume volume-44d28410-a05e-4979-9c19-ca7e65dad970 (44d28410-a05e-4979-9c19-ca7e65dad970): created successfully Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43f1e8-778b-4b2d-9901-94d71270bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (19db8d0e-2490-4ac0-a2bd-41c517fe7021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-49552e0c-e775-4955-b943-8a823ff14601 tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Acquiring lock "cinder-quobyte-9585f618-8d72-4f18-be7e-182500576d07" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "cinder-quobyte-9585f618-8d72-4f18-be7e-182500576d07" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0d572-0ebd-4bec-9c1e-25c6dc57efcb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:21 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:12:21 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:21 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 1073741824" returned: 0 in 0.679s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:21 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 Nov 03 12:12:21 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:21 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.524s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-44d28410-a05e-4979-9c19-ca7e65dad970-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:21 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07 Nov 03 12:12:21 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "cinder-44d28410-a05e-4979-9c19-ca7e65dad970-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-quobyte-44d28410-a05e-4979-9c19-ca7e65dad970" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-44d28410-a05e-4979-9c19-ca7e65dad970" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be2b0bf-c8c1-4983-8d14-040b7bc5c428]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:21 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3" returned: 0 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcb175d-3877-4470-8778-b03c0c05ec10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8a0298-c868-4d1b-ad53-815406077eb3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a64c0e-5259-4dfd-ad0a-d0310955a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Volume volume-0c8a0298-c868-4d1b-ad53-815406077eb3 (0c8a0298-c868-4d1b-ad53-815406077eb3): created successfully Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a64c0e-5259-4dfd-ad0a-d0310955a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Flow 'volume_create_manager' (962875eb-347e-491d-9f64-0f0dd7e35998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-05195c47-e683-4b5b-a7f1-1e112c953ed8 tempest-VolumesTransfersV357Test-2029598487 None] Created volume successfully. Nov 03 12:12:22 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 Nov 03 12:12:22 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:22 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9585f618-8d72-4f18-be7e-182500576d07" returned: 0 in 0.427s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "cinder-quobyte-9585f618-8d72-4f18-be7e-182500576d07" released by "delete_volume" :: held 1.040s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Created reservations ['1456183e-94df-4fcf-b010-764e690df932', '02ab4790-47a1-40eb-a321-c948201b65ad', '1175b626-bab7-4971-b275-eb0cca71b1ec', 'feb266fe-8a4d-4cd2-97d0-55b140ca45e2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:22 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:22 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:22 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970" returned: 0 in 0.589s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:22 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970 Nov 03 12:12:22 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:22 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.325s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Deleted volume successfully. Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b28ef158-f5fe-4787-938f-b873b6b3fba1 tempest-VolumesActionsTest-344910984 None] Lock "cinder-9585f618-8d72-4f18-be7e-182500576d07-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:22 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-44d28410-a05e-4979-9c19-ca7e65dad970" returned: 0 in 0.302s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-44d28410-a05e-4979-9c19-ca7e65dad970" released by "delete_volume" :: held 0.942s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Created reservations ['77bfe44d-d4a2-4d02-8307-343c8d9c4ef5', '5181e001-4e0e-4467-a96f-eed8bdc515a6', '5c2d3484-5cde-4f3c-878b-86a4c4018b88', '169af057-abfb-4df3-afea-c0c7dd28b587'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:22 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:22 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:23 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Deleted volume successfully. Nov 03 12:12:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0b1230a9-e4ad-4409-b1e6-bd8de85f680b tempest-VolumesActionsTest-654695495 None] Lock "cinder-44d28410-a05e-4979-9c19-ca7e65dad970-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:24 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:24 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2c28ccef-0a89-4385-bb63-7ce78e59e500 tempest-VolumesTransfersV357Test-1230330078 None] Transfer volume completed successfully. Nov 03 12:12:24 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.432s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (e1c46f96-5668-4681-9694-4695c1e63f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a35a91-b388-4f68-b2e0-038e3a7f4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a35a91-b388-4f68-b2e0-038e3a7f4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230416550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a50ed-7394-4143-87dc-c2bcc4715db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:25Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6320da7-e553-4e24-8b77-410193cb41a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6320da7-e553-4e24-8b77-410193cb41a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f8a467-9d82-4a0a-b27c-e0a39de06604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f8a467-9d82-4a0a-b27c-e0a39de06604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06a50ed-7394-4143-87dc-c2bcc4715db1', 'volume_name': 'volume-d06a50ed-7394-4143-87dc-c2bcc4715db1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d50d6b-aecf-4500-b96a-3bbc80d9026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d50d6b-aecf-4500-b96a-3bbc80d9026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b089120c-7d09-4997-83bf-acac92b3397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Volume d06a50ed-7394-4143-87dc-c2bcc4715db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06a50ed-7394-4143-87dc-c2bcc4715db1', 'volume_size': 1} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230416550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a50ed-7394-4143-87dc-c2bcc4715db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:25Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Creating volume d06a50ed-7394-4143-87dc-c2bcc4715db1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:25 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 1073741824 Nov 03 12:12:25 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "cinder-0c8a0298-c868-4d1b-ad53-815406077eb3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-0c8a0298-c868-4d1b-ad53-815406077eb3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "cinder-quobyte-0c8a0298-c868-4d1b-ad53-815406077eb3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-quobyte-0c8a0298-c868-4d1b-ad53-815406077eb3" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d148ff-564a-44ea-92cd-9d69d3a115f3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:25 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 Nov 03 12:12:25 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:25 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 1073741824" returned: 0 in 0.636s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:25 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 Nov 03 12:12:25 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:25 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3" returned: 0 in 0.501s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:25 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3 Nov 03 12:12:25 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:25 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b089120c-7d09-4997-83bf-acac92b3397b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06a50ed-7394-4143-87dc-c2bcc4715db1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b28ebb-a597-49d7-9b8d-821d0fd55fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:26 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Volume volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 (d06a50ed-7394-4143-87dc-c2bcc4715db1): created successfully Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b28ebb-a597-49d7-9b8d-821d0fd55fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (e1c46f96-5668-4681-9694-4695c1e63f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0c8a0298-c868-4d1b-ad53-815406077eb3" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-quobyte-0c8a0298-c868-4d1b-ad53-815406077eb3" released by "delete_volume" :: held 0.896s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f7b4384b-431e-457e-bddb-f5aa653d0480 tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Created reservations ['1718b6f8-155e-44e0-9974-a84c98476a93', '0091c33e-a71e-4863-9ec9-98d49ce1d7b9', '3b8acdd8-7786-4f88-ae84-466758a85a1a', '4b6fb5d8-b7f3-4080-9e79-dffa0b03f48f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:26 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:26 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:26 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Deleted volume successfully. Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f98d293f-b3fd-4df8-9ebf-719a851a7748 tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-0c8a0298-c868-4d1b-ad53-815406077eb3-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Flow 'volume_create_manager' (271b02a0-3c01-4513-9e39-8f46f0a0ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8817c949-5dd7-4b79-8d60-09a66e118cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8817c949-5dd7-4b79-8d60-09a66e118cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-976755999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04d2857-2538-414c-b464-0ded3470d9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9d8a2677224684bb3cd28981ca934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:27Z,use_quota=True,user_id='9f651acabe8344a99140e1d1057f1a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79d938-eb7f-4098-b2d7-a318dea77a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79d938-eb7f-4098-b2d7-a318dea77a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6274e5-8f72-48c9-86c7-8587d0bda2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6274e5-8f72-48c9-86c7-8587d0bda2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04d2857-2538-414c-b464-0ded3470d9df', 'volume_name': 'volume-b04d2857-2538-414c-b464-0ded3470d9df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef906f3b-b937-407a-a58e-f7136845735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef906f3b-b937-407a-a58e-f7136845735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d212155-6585-4cf3-b1c7-e658bac0ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Volume b04d2857-2538-414c-b464-0ded3470d9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04d2857-2538-414c-b464-0ded3470d9df', 'volume_size': 1} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-976755999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04d2857-2538-414c-b464-0ded3470d9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9d8a2677224684bb3cd28981ca934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:27Z,use_quota=True,user_id='9f651acabe8344a99140e1d1057f1a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Creating volume b04d2857-2538-414c-b464-0ded3470d9df {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:27 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:27 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df 1073741824 Nov 03 12:12:27 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-d06a50ed-7394-4143-87dc-c2bcc4715db1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "cinder-d06a50ed-7394-4143-87dc-c2bcc4715db1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-quobyte-d06a50ed-7394-4143-87dc-c2bcc4715db1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-d06a50ed-7394-4143-87dc-c2bcc4715db1" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2451d3a-d282-4808-86b0-99dff2cc4d7e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:27 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 Nov 03 12:12:27 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:27 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df 1073741824" returned: 0 in 0.636s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:27 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df Nov 03 12:12:27 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:27 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1" returned: 0 in 0.553s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:27 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1 Nov 03 12:12:27 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:28 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df" returned: 0 in 0.432s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d212155-6585-4cf3-b1c7-e658bac0ab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04d2857-2538-414c-b464-0ded3470d9df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d60038-3062-4ac1-af70-3025f4fdbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Volume volume-b04d2857-2538-414c-b464-0ded3470d9df (b04d2857-2538-414c-b464-0ded3470d9df): created successfully Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d60038-3062-4ac1-af70-3025f4fdbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:28 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Flow 'volume_create_manager' (271b02a0-3c01-4513-9e39-8f46f0a0ff42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d06a50ed-7394-4143-87dc-c2bcc4715db1" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-d06a50ed-7394-4143-87dc-c2bcc4715db1" released by "delete_volume" :: held 1.060s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1ef14996-7a3b-4165-a555-7a67063de184 tempest-VolumesTransfersV357Test-2029598487 None] Created volume successfully. Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Created reservations ['e37f3921-f82c-4fb5-85ea-47ee3f585c87', '2abb9bdb-aa90-45a1-9300-818a946664d1', '0a0e5322-9325-4c90-a321-e3bd170de65b', 'a3b5b218-c749-4656-97d0-8f8aa15a0052'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:28 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:28 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:28 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Deleted volume successfully. Nov 03 12:12:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-90239926-37af-40e3-a279-81f2fd057ab5 tempest-VolumesActionsTest-654695495 None] Lock "cinder-d06a50ed-7394-4143-87dc-c2bcc4715db1-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "cinder-b04d2857-2538-414c-b464-0ded3470d9df-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-b04d2857-2538-414c-b464-0ded3470d9df-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "cinder-quobyte-b04d2857-2538-414c-b464-0ded3470d9df" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-quobyte-b04d2857-2538-414c-b464-0ded3470d9df" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf3048-695a-4a5e-90a8-8ad5b6e7bd52]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:29 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df Nov 03 12:12:29 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:30 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df" returned: 0 in 0.562s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:30 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df Nov 03 12:12:30 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (f952b3c0-c173-4e4f-87e9-599270e3ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80375fe5-d2c9-4cdb-8bbc-23e6c1c88c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80375fe5-d2c9-4cdb-8bbc-23e6c1c88c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-308782575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc61657-692a-4d2c-bcc5-9c5ad8c91814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:30Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f558b9c6-293d-4c77-863b-3780341b03e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f558b9c6-293d-4c77-863b-3780341b03e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67eadcd4-5ff3-40c7-b354-8837451ae9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67eadcd4-5ff3-40c7-b354-8837451ae9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc61657-692a-4d2c-bcc5-9c5ad8c91814', 'volume_name': 'volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7ed5d4-3f16-40a0-a42c-d1e94d64e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7ed5d4-3f16-40a0-a42c-d1e94d64e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43be1b-a32a-44fb-85d3-91c7888857a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Volume 9bc61657-692a-4d2c-bcc5-9c5ad8c91814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814', 'volume_size': 1} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-308782575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc61657-692a-4d2c-bcc5-9c5ad8c91814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:30Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Creating volume 9bc61657-692a-4d2c-bcc5-9c5ad8c91814 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:30 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:30 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 1073741824 Nov 03 12:12:30 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:30 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b04d2857-2538-414c-b464-0ded3470d9df" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-quobyte-b04d2857-2538-414c-b464-0ded3470d9df" released by "delete_volume" :: held 1.013s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Created reservations ['0950507a-6725-4c6b-a8fa-2a60e03f7293', '655ebf6f-fa53-4556-9529-83980680c16b', '62e7af17-29fd-442c-9df1-a65890d74945', 'e04c4168-4ad1-4821-a3ef-cbbf21045a6c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:31 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:31 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:31 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 1073741824" returned: 0 in 0.618s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:31 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 Nov 03 12:12:31 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:31 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.328s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Deleted volume successfully. Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a245608b-faab-4aeb-9a2c-834955dac1ed tempest-VolumesTransfersV357Test-1678460701 None] Lock "cinder-b04d2857-2538-414c-b464-0ded3470d9df-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:31 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" returned: 0 in 0.315s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43be1b-a32a-44fb-85d3-91c7888857a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2df894-3b19-4349-a280-33ab220fd030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Volume volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 (9bc61657-692a-4d2c-bcc5-9c5ad8c91814): created successfully Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2df894-3b19-4349-a280-33ab220fd030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (f952b3c0-c173-4e4f-87e9-599270e3ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f8bee800-5257-4571-ba7e-1ee75257ce63 tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:12:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-9bc61657-692a-4d2c-bcc5-9c5ad8c91814-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "cinder-9bc61657-692a-4d2c-bcc5-9c5ad8c91814-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Acquiring lock "cinder-quobyte-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[128eca6e-5f8e-4d6b-b88e-39b759870855]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:33 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 Nov 03 12:12:33 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:33 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:33 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814 Nov 03 12:12:33 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:34 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" returned: 0 in 0.549s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "cinder-quobyte-9bc61657-692a-4d2c-bcc5-9c5ad8c91814" released by "delete_volume" :: held 1.429s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Created reservations ['7fd111ee-84d5-4c36-ac3f-4ddacd1c2486', '0e5d0e06-fc11-4c00-b416-ebe7b1e3d1dc', '377a94d5-11c9-4d2b-b058-a14aef8d2226', '08bcbe0e-988a-4e4d-b58e-3f3564e44dee'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:34 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:34 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:35 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.504s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:35 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Deleted volume successfully. Nov 03 12:12:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5338415-e5bf-4052-9396-f07960301a77 tempest-VolumesActionsTest-654695495 None] Lock "cinder-9bc61657-692a-4d2c-bcc5-9c5ad8c91814-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (e83b103b-b4e7-4a7e-859c-4e7bd6d7d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40fe7f7-a28a-4a04-9dde-a1a4f0cfcd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40fe7f7-a28a-4a04-9dde-a1a4f0cfcd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772889279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c600dd3c-e5b5-43b8-a7cb-55437607e953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:36Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5f49b7-0162-463f-9805-349a94dab0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5f49b7-0162-463f-9805-349a94dab0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3576ccdc-5b8e-45ed-baa8-5705105feebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3576ccdc-5b8e-45ed-baa8-5705105feebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c600dd3c-e5b5-43b8-a7cb-55437607e953', 'volume_name': 'volume-c600dd3c-e5b5-43b8-a7cb-55437607e953', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebdeb4c-5507-40b1-bed1-c8e13318e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebdeb4c-5507-40b1-bed1-c8e13318e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42869da-31db-426e-bd4c-82b9e009f4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Volume c600dd3c-e5b5-43b8-a7cb-55437607e953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c600dd3c-e5b5-43b8-a7cb-55437607e953', 'volume_size': 1} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772889279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c600dd3c-e5b5-43b8-a7cb-55437607e953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f99ac99a704afda48de122bbac006f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:36Z,use_quota=True,user_id='71070790927148318f5fa14ba86882fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Creating volume c600dd3c-e5b5-43b8-a7cb-55437607e953 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:36 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:36 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 1073741824 Nov 03 12:12:36 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:37 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 1073741824" returned: 0 in 0.741s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:37 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 Nov 03 12:12:37 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:37 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42869da-31db-426e-bd4c-82b9e009f4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c600dd3c-e5b5-43b8-a7cb-55437607e953', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b3cfdc-a1e5-4938-9178-942f0b58a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Volume volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 (c600dd3c-e5b5-43b8-a7cb-55437607e953): created successfully Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b3cfdc-a1e5-4938-9178-942f0b58a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Flow 'volume_create_manager' (e83b103b-b4e7-4a7e-859c-4e7bd6d7d50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5eb33f10-50f1-42f6-8cd0-3a7f309b4622 tempest-VolumesActionsTest-275650487 None] Created volume successfully. Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-c600dd3c-e5b5-43b8-a7cb-55437607e953-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "cinder-c600dd3c-e5b5-43b8-a7cb-55437607e953-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Acquiring lock "cinder-quobyte-c600dd3c-e5b5-43b8-a7cb-55437607e953" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "cinder-quobyte-c600dd3c-e5b5-43b8-a7cb-55437607e953" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb62f32-178d-4bf3-b9f3-10fbd1838a75]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:39 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 Nov 03 12:12:39 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:40 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953" returned: 0 in 0.581s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:40 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953 Nov 03 12:12:40 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:40 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c600dd3c-e5b5-43b8-a7cb-55437607e953" returned: 0 in 0.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "cinder-quobyte-c600dd3c-e5b5-43b8-a7cb-55437607e953" released by "delete_volume" :: held 1.112s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Created reservations ['dafbebb2-95b2-4dfd-89b2-8734bbd48556', '1ba88e01-c1a0-4f9e-8ced-f305318b1090', 'b0610c6b-b8ac-4409-afb4-e0a3634d3fce', 'f9fd3952-f1a9-40e4-943e-76e9e4261619'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:40 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:41 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:41 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.586s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:41 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Deleted volume successfully. Nov 03 12:12:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d233498f-2da5-47bc-b320-e5d4c361f73e tempest-VolumesActionsTest-275650487 None] Lock "cinder-c600dd3c-e5b5-43b8-a7cb-55437607e953-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Flow 'volume_create_manager' (a125651f-ce07-45c5-b4c6-172a839fb098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef8750f-5895-4274-b9c7-3ff18945a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef8750f-5895-4274-b9c7-3ff18945a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-88164358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a8fd79-8514-46b4-8f20-7dbe72611911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85486f4dc4894c129fa4f079ecc20fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:45Z,use_quota=True,user_id='e89d73e755e84869a4f847a69cc6eced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dbaf47-3981-4c61-9ee7-4c7b2d477a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dbaf47-3981-4c61-9ee7-4c7b2d477a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5f275-403b-49a1-b22c-66961172dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5f275-403b-49a1-b22c-66961172dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a8fd79-8514-46b4-8f20-7dbe72611911', 'volume_name': 'volume-60a8fd79-8514-46b4-8f20-7dbe72611911', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c0e53c-7809-4e92-81de-f9642845b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c0e53c-7809-4e92-81de-f9642845b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412210a8-881c-4f50-8e58-88dd0c660bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:45 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Volume 60a8fd79-8514-46b4-8f20-7dbe72611911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a8fd79-8514-46b4-8f20-7dbe72611911', 'volume_size': 2} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-88164358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a8fd79-8514-46b4-8f20-7dbe72611911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85486f4dc4894c129fa4f079ecc20fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:45Z,use_quota=True,user_id='e89d73e755e84869a4f847a69cc6eced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Creating volume 60a8fd79-8514-46b4-8f20-7dbe72611911 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:45 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 2147483648 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:45 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 2147483648 Nov 03 12:12:45 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:46 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 2147483648" returned: 0 in 0.621s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:46 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 Nov 03 12:12:46 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:46 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911" returned: 0 in 0.271s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412210a8-881c-4f50-8e58-88dd0c660bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a8fd79-8514-46b4-8f20-7dbe72611911', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246b3727-7b3c-4fe3-b8c2-113b6f064c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Volume volume-60a8fd79-8514-46b4-8f20-7dbe72611911 (60a8fd79-8514-46b4-8f20-7dbe72611911): created successfully Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246b3727-7b3c-4fe3-b8c2-113b6f064c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Flow 'volume_create_manager' (a125651f-ce07-45c5-b4c6-172a839fb098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8d005633-fc4f-4aa0-b5b1-f64368f2227a tempest-VolumesCloneNegativeTest-917637833 None] Created volume successfully. Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Acquiring lock "cinder-60a8fd79-8514-46b4-8f20-7dbe72611911-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "cinder-60a8fd79-8514-46b4-8f20-7dbe72611911-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Acquiring lock "cinder-quobyte-60a8fd79-8514-46b4-8f20-7dbe72611911" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "cinder-quobyte-60a8fd79-8514-46b4-8f20-7dbe72611911" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb8fab-e48a-4610-9e2a-aab60b4ce2e2]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:48 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 Nov 03 12:12:48 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:48 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911" returned: 0 in 0.487s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:48 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911 Nov 03 12:12:48 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:48 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-60a8fd79-8514-46b4-8f20-7dbe72611911" returned: 0 in 0.304s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "cinder-quobyte-60a8fd79-8514-46b4-8f20-7dbe72611911" released by "delete_volume" :: held 0.885s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Created reservations ['669028bc-bc7a-4ae5-8825-2cc0df4fda9a', '531e1b08-1750-4529-8274-e84aa44f3fde', '8cc500bc-3333-411f-8288-0ae83fea7e1b', 'a361132b-81bf-4756-8392-240d1e846a97'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:48 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:12:48 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:49 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:12:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Deleted volume successfully. Nov 03 12:12:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7523fee-5f1b-42ad-89fd-bc26cf98f316 tempest-VolumesCloneNegativeTest-917637833 None] Lock "cinder-60a8fd79-8514-46b4-8f20-7dbe72611911-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (3b424bb8-5b9c-49fa-83ad-30a677f7c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d185266-6bbc-4a86-848e-41ca120ad47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d185266-6bbc-4a86-848e-41ca120ad47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76106719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fde2617-b597-43c5-bb0e-2d8a6609c505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:50Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a785d23-315f-4c49-b80f-956347027a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a785d23-315f-4c49-b80f-956347027a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271d099c-4cf0-447e-9b75-d1c95eae900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271d099c-4cf0-447e-9b75-d1c95eae900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fde2617-b597-43c5-bb0e-2d8a6609c505', 'volume_name': 'volume-4fde2617-b597-43c5-bb0e-2d8a6609c505', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe02ab44-402f-4208-a5d3-d9476e1818df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe02ab44-402f-4208-a5d3-d9476e1818df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec5892a-d5c4-4cc4-a270-be3902fdfffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Volume 4fde2617-b597-43c5-bb0e-2d8a6609c505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fde2617-b597-43c5-bb0e-2d8a6609c505', 'volume_size': 1} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76106719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fde2617-b597-43c5-bb0e-2d8a6609c505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:50Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Creating volume 4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:50 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 1073741824 Nov 03 12:12:50 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:51 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 1073741824" returned: 0 in 0.516s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:51 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 Nov 03 12:12:51 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:51 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505" returned: 0 in 0.316s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec5892a-d5c4-4cc4-a270-be3902fdfffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fde2617-b597-43c5-bb0e-2d8a6609c505', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126b46b-e27d-4604-b82b-66feec5623b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Volume volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 (4fde2617-b597-43c5-bb0e-2d8a6609c505): created successfully Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126b46b-e27d-4604-b82b-66feec5623b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (3b424bb8-5b9c-49fa-83ad-30a677f7c339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-93b557db-a430-4fb5-a4a4-53a3f56de863 tempest-VolumesSnapshotTestJSON-955460215 None] Created volume successfully. Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Creating offline snapshot 15b18960-ec72-42de-aa41-29ae2eac081c of volume 4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08f141-6557-48da-a2f8-3180f6979cda]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:53 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 Nov 03 12:12:53 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (18f0d0cc-ccc9-4c46-a27a-fbe97f3407db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90de9a5-a087-4536-bc03-18443710744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90de9a5-a087-4536-bc03-18443710744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2105819749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597980de-dc89-46e2-8df2-3585a046a7c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:54Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:53 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233b0823-8841-41d5-b369-5a2a640f32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233b0823-8841-41d5-b369-5a2a640f32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35db702-227d-4d27-b164-cbc8734b3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35db702-227d-4d27-b164-cbc8734b3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597980de-dc89-46e2-8df2-3585a046a7c1', 'volume_name': 'volume-597980de-dc89-46e2-8df2-3585a046a7c1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8979ba4-bf51-4b26-91ac-0eb683512b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8979ba4-bf51-4b26-91ac-0eb683512b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1981c0-2acf-42c1-87cd-1d8d2ef8b089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Volume 597980de-dc89-46e2-8df2-3585a046a7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597980de-dc89-46e2-8df2-3585a046a7c1', 'volume_size': 1} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505" returned: 0 in 0.523s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:53 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c 1G Nov 03 12:12:53 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:54 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c 1G" returned: 0 in 0.473s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:54 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c Nov 03 12:12:54 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:54 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:54 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c is being set with open permissions: ugo+rw Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:54 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c Nov 03 12:12:54 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:54 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:54 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info Nov 03 12:12:54 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:55 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:55 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info is being set with open permissions: ugo+rw Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:55 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info Nov 03 12:12:55 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:55 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.info" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2105819749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597980de-dc89-46e2-8df2-3585a046a7c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:54Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Creating volume 597980de-dc89-46e2-8df2-3585a046a7c1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:55 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 1073741824 Nov 03 12:12:55 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9465eb9b-a8e3-463a-82e0-b1bc851915c8 tempest-VolumesSnapshotTestJSON-955460215 None] Create snapshot completed successfully Nov 03 12:12:55 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 1073741824" returned: 0 in 0.499s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:56 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 Nov 03 12:12:56 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:56 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=86,cinder:UPDATE=122,cinder:INSERT=29,cinder:DELETE=13 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1981c0-2acf-42c1-87cd-1d8d2ef8b089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597980de-dc89-46e2-8df2-3585a046a7c1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579db86b-397d-4335-b63b-55c6c79d7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=83,cinder:INSERT=27,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:12:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Volume volume-597980de-dc89-46e2-8df2-3585a046a7c1 (597980de-dc89-46e2-8df2-3585a046a7c1): created successfully Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579db86b-397d-4335-b63b-55c6c79d7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (18f0d0cc-ccc9-4c46-a27a-fbe97f3407db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-65887ce5-6190-416d-928a-8033c89a7956 tempest-VolumesListTestJSON-1468701416 None] Created volume successfully. Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-15b18960-ec72-42de-aa41-29ae2eac081c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-15b18960-ec72-42de-aa41-29ae2eac081c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-15b18960-ec72-42de-aa41-29ae2eac081c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-15b18960-ec72-42de-aa41-29ae2eac081c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Deleting offline snapshot 15b18960-ec72-42de-aa41-29ae2eac081c of volume 4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] snapshot_file for this snap is: volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f899851-f664-47ad-bce5-fe49cd2b82de]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:56 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c Nov 03 12:12:56 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:56 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fde2617-b597-43c5-bb0e-2d8a6609c505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f724482-4551-4d72-a36b-4ea9234348f1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:57 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 Nov 03 12:12:57 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (3121980f-694f-4a9e-8585-f4603d8cc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c25637e-bd22-4116-9347-257dd478d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c25637e-bd22-4116-9347-257dd478d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-483985658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fcfca1-806e-4956-a1f5-2e045d9a2fa4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:57Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454fdc8d-6173-4ef8-b871-d3446cf7555f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454fdc8d-6173-4ef8-b871-d3446cf7555f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c599de-3171-4796-812d-788324462c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c599de-3171-4796-812d-788324462c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fcfca1-806e-4956-a1f5-2e045d9a2fa4', 'volume_name': 'volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2f399-2f27-4c02-8ea9-b25c25f7ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2f399-2f27-4c02-8ea9-b25c25f7ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55824d6-70b5-45f2-a933-ea4b17344554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Volume 21fcfca1-806e-4956-a1f5-2e045d9a2fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4', 'volume_size': 1} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-483985658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fcfca1-806e-4956-a1f5-2e045d9a2fa4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:57Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Creating volume 21fcfca1-806e-4956-a1f5-2e045d9a2fa4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:57 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 1073741824 Nov 03 12:12:57 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:57 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:57 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c Nov 03 12:12:57 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:57 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:57 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 1073741824" returned: 0 in 0.495s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:57 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c Nov 03 12:12:57 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:57 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 Nov 03 12:12:57 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:58 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505.15b18960-ec72-42de-aa41-29ae2eac081c" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-15b18960-ec72-42de-aa41-29ae2eac081c" released by "_delete_snapshot" :: held 1.627s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:58 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" released by "delete_snapshot" :: held 1.669s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55824d6-70b5-45f2-a933-ea4b17344554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101782b4-863c-4d6a-ab7d-9f33142f1535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Volume volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 (21fcfca1-806e-4956-a1f5-2e045d9a2fa4): created successfully Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101782b4-863c-4d6a-ab7d-9f33142f1535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (3121980f-694f-4a9e-8585-f4603d8cc525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c14500d6-5420-4206-9af3-9fbc53cde903 tempest-VolumesListTestJSON-1468701416 None] Created volume successfully. Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['a274367a-9153-4218-b7b5-407b996af8a4', '8e407d34-3175-4cb9-baa8-f1449130dbba', '901ecb09-a84e-4439-9d37-5ffa3d16de4d', '36eeb214-4244-4e6d-999a-6b8bfd12d3a0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:12:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Delete snapshot completed successfully. Nov 03 12:12:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23758221-c5b7-41f0-a8cc-2bb3aaa619cd tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-15b18960-ec72-42de-aa41-29ae2eac081c-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (a82b17ab-4137-426e-860e-5998e6b46268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3253559-8a1f-4708-bfb7-57625ecf2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3253559-8a1f-4708-bfb7-57625ecf2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-751888735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8de094-b58d-4b9c-9dba-33c0bb9306e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:59Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958d2b32-9a62-4515-9062-47916fdf35e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958d2b32-9a62-4515-9062-47916fdf35e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341ae5ce-ef80-4ce8-85ef-c8bd895bb0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341ae5ce-ef80-4ce8-85ef-c8bd895bb0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8de094-b58d-4b9c-9dba-33c0bb9306e9', 'volume_name': 'volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371f4964-b771-4790-a72f-626d1f4f6480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371f4964-b771-4790-a72f-626d1f4f6480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365e2bd3-81bd-4a5b-a545-3d91f323691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Volume fc8de094-b58d-4b9c-9dba-33c0bb9306e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9', 'volume_size': 1} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-751888735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8de094-b58d-4b9c-9dba-33c0bb9306e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:59Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Creating volume fc8de094-b58d-4b9c-9dba-33c0bb9306e9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:12:59 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:12:59 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 1073741824 Nov 03 12:12:59 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (ac4c104f-ebff-4a36-bb40-b982372f644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddc7eb5-b8ca-4951-8eb7-44fd9febd577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddc7eb5-b8ca-4951-8eb7-44fd9febd577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444471733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6096537-6aca-4166-8b90-c3ab8207cf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:59Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f3d57f-8569-4dff-b694-0c793cd74164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f3d57f-8569-4dff-b694-0c793cd74164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2341753-38b1-436a-a782-d3aa5e3fd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2341753-38b1-436a-a782-d3aa5e3fd901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6096537-6aca-4166-8b90-c3ab8207cf5d', 'volume_name': 'volume-d6096537-6aca-4166-8b90-c3ab8207cf5d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceece44-5d7f-47aa-a892-eb8d43bbf348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceece44-5d7f-47aa-a892-eb8d43bbf348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e31592a-9fc8-49c8-9690-58638640ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Volume d6096537-6aca-4166-8b90-c3ab8207cf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6096537-6aca-4166-8b90-c3ab8207cf5d', 'volume_size': 1} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (f787101d-1bee-46e2-b2a5-dfc65bcad1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aad603-1189-44db-b794-2eaf2ff715de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aad603-1189-44db-b794-2eaf2ff715de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-494153611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24bf3c-0f09-45b7-98f2-959a891e1cfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:00Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d679980-52a5-498d-acf2-ac47facea128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d679980-52a5-498d-acf2-ac47facea128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4a3761-fab0-4f6e-87af-d6dc9eb9af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4a3761-fab0-4f6e-87af-d6dc9eb9af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf24bf3c-0f09-45b7-98f2-959a891e1cfa', 'volume_name': 'volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f582e272-2ad7-4a4e-96e8-be13f5ce9adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f582e272-2ad7-4a4e-96e8-be13f5ce9adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421368e3-20e1-46e0-b72a-f1a6e3dbc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:12:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Volume bf24bf3c-0f09-45b7-98f2-959a891e1cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa', 'volume_size': 1} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 1073741824" returned: 0 in 0.635s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:00 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 Nov 03 12:13:00 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (6ae18436-7c6b-4450-926c-fbca384a33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6c3baf-b63c-4141-8ee3-201746419c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6c3baf-b63c-4141-8ee3-201746419c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1001089370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4a15c6-4821-4b63-b7ed-f8b1efa025cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:00Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9bf006-f9bf-45ce-b166-bbfadd6ca330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9bf006-f9bf-45ce-b166-bbfadd6ca330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3794b49e-882e-4f2b-8cba-c1e56575e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3794b49e-882e-4f2b-8cba-c1e56575e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4a15c6-4821-4b63-b7ed-f8b1efa025cf', 'volume_name': 'volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c57f7d8-aebf-4379-acdc-171b7cd166b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c57f7d8-aebf-4379-acdc-171b7cd166b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8dcd62e-e416-413d-8c82-cde46b5b17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Volume 5a4a15c6-4821-4b63-b7ed-f8b1efa025cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf', 'volume_size': 1} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:00 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444471733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6096537-6aca-4166-8b90-c3ab8207cf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:12:59Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Creating volume d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365e2bd3-81bd-4a5b-a545-3d91f323691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d 1073741824 Nov 03 12:13:00 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852dc437-dc4f-4f9a-987d-53d162f2847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Volume volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 (fc8de094-b58d-4b9c-9dba-33c0bb9306e9): created successfully Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852dc437-dc4f-4f9a-987d-53d162f2847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (a82b17ab-4137-426e-860e-5998e6b46268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f36eb8f0-d9de-496b-a835-7673c7126c0d tempest-VolumesListAdminTestJSON-2112525977 None] Created volume successfully. Nov 03 12:13:00 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d 1073741824" returned: 0 in 0.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:00 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:00 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:00 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-494153611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24bf3c-0f09-45b7-98f2-959a891e1cfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='860cbcf943304c99b789f74a3d7fd1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:00Z,use_quota=True,user_id='657639185a5b47f787b9e1d50d7fe340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Creating volume bf24bf3c-0f09-45b7-98f2-959a891e1cfa {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e31592a-9fc8-49c8-9690-58638640ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6096537-6aca-4166-8b90-c3ab8207cf5d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9998185a-503a-41e0-9320-acf04d6b919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa 1073741824 Nov 03 12:13:01 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Volume volume-d6096537-6aca-4166-8b90-c3ab8207cf5d (d6096537-6aca-4166-8b90-c3ab8207cf5d): created successfully Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9998185a-503a-41e0-9320-acf04d6b919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (ac4c104f-ebff-4a36-bb40-b982372f644a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7dd20453-dc8f-4477-8e43-c220beb39aca tempest-VolumesSnapshotTestJSON-955460215 None] Created volume successfully. Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:01 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa 1073741824" returned: 0 in 0.534s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:01 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa Nov 03 12:13:01 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (149f550a-9d28-4e2e-965e-60e279f1c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077cff96-fc5b-4505-a42d-7b2ce1f4de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077cff96-fc5b-4505-a42d-7b2ce1f4de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333831206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c96daf-8853-4e4e-908e-2c2625c7243d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:02Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cac1ee-1904-44ac-9602-7f594c7ed415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cac1ee-1904-44ac-9602-7f594c7ed415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde0bf8-4a60-49e2-8240-07c594067b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde0bf8-4a60-49e2-8240-07c594067b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c96daf-8853-4e4e-908e-2c2625c7243d', 'volume_name': 'volume-20c96daf-8853-4e4e-908e-2c2625c7243d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffc0022-90de-470b-bda1-ba9f6767ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffc0022-90de-470b-bda1-ba9f6767ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06ba259-af23-4d82-9d2c-d1962a158376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Volume 20c96daf-8853-4e4e-908e-2c2625c7243d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c96daf-8853-4e4e-908e-2c2625c7243d', 'volume_size': 1} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" returned: 0 in 0.267s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1001089370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4a15c6-4821-4b63-b7ed-f8b1efa025cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:00Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Creating volume 5a4a15c6-4821-4b63-b7ed-f8b1efa025cf {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421368e3-20e1-46e0-b72a-f1a6e3dbc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf 1073741824 Nov 03 12:13:01 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9f9c01-d67d-43fb-90a4-57363a99e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Volume volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa (bf24bf3c-0f09-45b7-98f2-959a891e1cfa): created successfully Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9f9c01-d67d-43fb-90a4-57363a99e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Flow 'volume_create_manager' (f787101d-1bee-46e2-b2a5-dfc65bcad1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-536b8a31-5cf6-4c16-90b1-59b1ba04cadb tempest-VolumesListTestJSON-1468701416 None] Created volume successfully. Nov 03 12:13:02 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf 1073741824" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:02 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf Nov 03 12:13:02 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:02 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.119s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Creating offline snapshot 4755786b-5296-46b3-9793-3c8d0544c992 of volume d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8dcd62e-e416-413d-8c82-cde46b5b17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce347b4-11c7-44dd-8c64-ed80e3ea8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c77dd4-bfc1-432a-b9e7-78d39e2e00b4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Volume volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf (5a4a15c6-4821-4b63-b7ed-f8b1efa025cf): created successfully Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce347b4-11c7-44dd-8c64-ed80e3ea8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (6ae18436-7c6b-4450-926c-fbca384a33e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-017330ec-4e71-4dd9-9343-d2f9639a8f94 tempest-AttachVolumeNegativeTest-67719601 None] Created volume successfully. Nov 03 12:13:02 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:02 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:02 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:02 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 1G Nov 03 12:13:02 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:03 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 1G" returned: 0 in 0.520s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6096537-6aca-4166-8b90-c3ab8207cf5d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:03 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6096537-6aca-4166-8b90-c3ab8207cf5d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:03 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:03 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6096537-6aca-4166-8b90-c3ab8207cf5d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.372s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 is being set with open permissions: ugo+rw Nov 03 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:03 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:03 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-4251d697-3323-461f-9f72-2d0b49a1293b req-cc979ed3-96ad-4174-add6-91a40ef8bb41 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:04 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:04 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info Nov 03 12:13:04 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:04 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info is being set with open permissions: ugo+rw Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:04 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info Nov 03 12:13:04 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:04 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.info" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.851s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333831206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c96daf-8853-4e4e-908e-2c2625c7243d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:02Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Creating volume 20c96daf-8853-4e4e-908e-2c2625c7243d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:04 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d 1073741824 Nov 03 12:13:04 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-49868c05-e707-4ae4-a9c7-c64a69dc5bd6 tempest-VolumesSnapshotTestJSON-955460215 None] Create snapshot completed successfully Nov 03 12:13:05 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d 1073741824" returned: 0 in 0.457s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:05 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d Nov 03 12:13:05 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-bf24bf3c-0f09-45b7-98f2-959a891e1cfa-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-bf24bf3c-0f09-45b7-98f2-959a891e1cfa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-quobyte-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d2207-596e-4fc4-bda6-c1ecce64a33a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:05 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-4251d697-3323-461f-9f72-2d0b49a1293b req-cc979ed3-96ad-4174-add6-91a40ef8bb41 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.410s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-4251d697-3323-461f-9f72-2d0b49a1293b req-cc979ed3-96ad-4174-add6-91a40ef8bb41 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06ba259-af23-4d82-9d2c-d1962a158376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c96daf-8853-4e4e-908e-2c2625c7243d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c50661-7507-4a50-a1d0-7a1d9a6ab4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Volume volume-20c96daf-8853-4e4e-908e-2c2625c7243d (20c96daf-8853-4e4e-908e-2c2625c7243d): created successfully Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c50661-7507-4a50-a1d0-7a1d9a6ab4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (149f550a-9d28-4e2e-965e-60e279f1c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-14361819-e502-4af5-b9e7-808d5bf76f77 tempest-VolumesListAdminTestJSON-2112525977 None] Created volume successfully. Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-4251d697-3323-461f-9f72-2d0b49a1293b req-cc979ed3-96ad-4174-add6-91a40ef8bb41 tempest-AttachVolumeNegativeTest-67719601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8f51fec-7093-4966-835c-bcfcf88f2e07', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:13:05 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa Nov 03 12:13:05 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-4251d697-3323-461f-9f72-2d0b49a1293b req-cc979ed3-96ad-4174-add6-91a40ef8bb41 tempest-AttachVolumeNegativeTest-67719601 None] attachment_update completed successfully. Nov 03 12:13:05 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" returned: 0 in 0.435s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:05 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa Nov 03 12:13:05 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:06 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-bf24bf3c-0f09-45b7-98f2-959a891e1cfa" released by "delete_volume" :: held 0.872s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (5d020980-b3f3-4c26-bedd-6ccafd0771f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db0cece-f818-430a-b386-891049e20651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db0cece-f818-430a-b386-891049e20651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530298915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b54fc15-a06e-41b2-9948-6dc2ecab257c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4755786b-5296-46b3-9793-3c8d0544c992,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:06Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3995c2-6bc8-4a57-ada1-94afdd87f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3995c2-6bc8-4a57-ada1-94afdd87f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3daeb8-8195-4ba4-b89d-f111ec7986b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3daeb8-8195-4ba4-b89d-f111ec7986b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b54fc15-a06e-41b2-9948-6dc2ecab257c', 'volume_name': 'volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c', 'volume_size': 2, 'snapshot_id': '4755786b-5296-46b3-9793-3c8d0544c992'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d524d47c-d496-4b15-9a3b-27dde261a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d524d47c-d496-4b15-9a3b-27dde261a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c641f8-68c4-4eb5-8198-1777339ae5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Volume 4b54fc15-a06e-41b2-9948-6dc2ecab257c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c', 'volume_size': 2, 'snapshot_id': '4755786b-5296-46b3-9793-3c8d0544c992'} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992-4b54fc15-a06e-41b2-9948-6dc2ecab257c" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Created reservations ['14505c6e-2098-48b6-a85a-4a03d7272cbc', '99b57b85-6dac-48ec-bb0b-162d8a3d64f7', '7628e667-fd2c-4884-884e-6b88c7accceb', '20159f29-623f-4468-8d73-b6b7b5256a06'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992-4b54fc15-a06e-41b2-9948-6dc2ecab257c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Creating volume 4b54fc15-a06e-41b2-9948-6dc2ecab257c from snapshot 4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] snapshot: 4755786b-5296-46b3-9793-3c8d0544c992, volume: 4b54fc15-a06e-41b2-9948-6dc2ecab257c, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[607dbd5a-be5d-4d84-a65d-1c7b5ef210a7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:06 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:06 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:06 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:06 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (934f0d7d-8de8-47d7-9392-3ca1d8483335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae7f645-8b4f-48a9-b6aa-367d662c44ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae7f645-8b4f-48a9-b6aa-367d662c44ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-676949977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23e7bf1-4473-422d-b9ea-7da783ade694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:07Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05996a0a-6916-4042-9269-fa3b8b19e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05996a0a-6916-4042-9269-fa3b8b19e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b140b3f-4e87-4e00-b112-7f6731dd2462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b140b3f-4e87-4e00-b112-7f6731dd2462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23e7bf1-4473-422d-b9ea-7da783ade694', 'volume_name': 'volume-b23e7bf1-4473-422d-b9ea-7da783ade694', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2339864f-820a-45c2-88e6-27965580eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2339864f-820a-45c2-88e6-27965580eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15322155-35e3-4191-847e-b0231a830e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Volume b23e7bf1-4473-422d-b9ea-7da783ade694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23e7bf1-4473-422d-b9ea-7da783ade694', 'volume_size': 1} Nov 03 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:07 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.267s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Deleted volume successfully. Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6cba6dd5-0a7b-4ba8-9857-77e716fcf6b6 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-bf24bf3c-0f09-45b7-98f2-959a891e1cfa-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:07 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.437s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6096537-6aca-4166-8b90-c3ab8207cf5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a5d3c-8967-400a-ba56-1102e7dc20e9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:07 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:07 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:07 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.403s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:07 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c Nov 03 12:13:07 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-21fcfca1-806e-4956-a1f5-2e045d9a2fa4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-21fcfca1-806e-4956-a1f5-2e045d9a2fa4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-quobyte-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44dc9f6-ff02-412a-9baa-c25242be0716]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:07 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 Nov 03 12:13:07 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:08 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" returned: 0 in 0.502s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:08 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4 Nov 03 12:13:08 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:08 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-21fcfca1-806e-4956-a1f5-2e045d9a2fa4" released by "delete_volume" :: held 1.066s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Created reservations ['ab38f4da-6ce8-4326-a4c4-77a4572ded25', 'c940dedd-dece-4e08-9fa4-97437e1ec2d9', 'e554dc2f-cb2c-424b-a7a9-d2b92400122b', 'c2f3722b-d505-4a21-9062-725f44016756'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:09 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:09 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:09 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.543s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Deleted volume successfully. Nov 03 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ec58a836-bed0-4aac-a1b1-5e78c88084f8 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-21fcfca1-806e-4956-a1f5-2e045d9a2fa4-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-597980de-dc89-46e2-8df2-3585a046a7c1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-597980de-dc89-46e2-8df2-3585a046a7c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "cinder-quobyte-597980de-dc89-46e2-8df2-3585a046a7c1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-597980de-dc89-46e2-8df2-3585a046a7c1" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2cfc03-6aeb-4fbc-9f35-e1dfb4bd4a4e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:10 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 Nov 03 12:13:10 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:11 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:11 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1 Nov 03 12:13:11 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:11 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-597980de-dc89-46e2-8df2-3585a046a7c1" returned: 0 in 0.374s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-quobyte-597980de-dc89-46e2-8df2-3585a046a7c1" released by "delete_volume" :: held 1.145s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Created reservations ['e7143db6-e097-4ca2-8d1c-18d40bfc1a2f', '10975612-5648-488d-b648-80b64fa10311', 'e76ca8ac-5192-4d7e-b68d-919d768156f6', 'c513a4de-1013-4073-892d-52c592c751d6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:11 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:11 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:12 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Deleted volume successfully. Nov 03 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0ebaa5b0-62ee-4de5-83ef-066ff9f7e0a9 tempest-VolumesListTestJSON-1468701416 None] Lock "cinder-597980de-dc89-46e2-8df2-3585a046a7c1-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:16 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c" returned: 0 in 9.129s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:13:16 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Converted 1024.00 MB image at 112.16 MB/s Nov 03 12:13:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c is being set with open permissions: ugo+rw Nov 03 12:13:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:16 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c Nov 03 12:13:16 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:16 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c" returned: 0 in 0.287s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" released by "_copy_volume_from_snapshot" :: held 10.412s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992-4b54fc15-a06e-41b2-9948-6dc2ecab257c" released by "_create_volume_from_snapshot" :: held 10.495s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.527s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.142s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-676949977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23e7bf1-4473-422d-b9ea-7da783ade694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535f4575ede84f779d49b4706b2c5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:07Z,use_quota=True,user_id='cd1fab24e23247a28354413f59366f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Creating volume b23e7bf1-4473-422d-b9ea-7da783ade694 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:17 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 1073741824 Nov 03 12:13:17 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c641f8-68c4-4eb5-8198-1777339ae5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c', 'volume_size': 2, 'snapshot_id': '4755786b-5296-46b3-9793-3c8d0544c992'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50923836-1d77-407b-8015-817180149f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Volume volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c (4b54fc15-a06e-41b2-9948-6dc2ecab257c): created successfully Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50923836-1d77-407b-8015-817180149f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (5d020980-b3f3-4c26-bedd-6ccafd0771f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-83285f23-40ed-45b3-b580-637507f32cd9 tempest-VolumesSnapshotTestJSON-955460215 None] Created volume successfully. Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-4b54fc15-a06e-41b2-9948-6dc2ecab257c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:17 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 1073741824" returned: 0 in 0.588s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4b54fc15-a06e-41b2-9948-6dc2ecab257c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:17 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 Nov 03 12:13:17 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7740777e-4c40-452a-aa95-ef60d01a97cb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:18 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c Nov 03 12:13:18 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:18 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15322155-35e3-4191-847e-b0231a830e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23e7bf1-4473-422d-b9ea-7da783ade694', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9284e46c-d758-4302-b5ce-d5fd3982f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Volume volume-b23e7bf1-4473-422d-b9ea-7da783ade694 (b23e7bf1-4473-422d-b9ea-7da783ade694): created successfully Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9284e46c-d758-4302-b5ce-d5fd3982f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Flow 'volume_create_manager' (934f0d7d-8de8-47d7-9392-3ca1d8483335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e89de5d7-c9cc-40c5-8eb5-4e285b536e72 tempest-VolumesListAdminTestJSON-2112525977 None] Created volume successfully. Nov 03 12:13:18 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c" returned: 0 in 0.529s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:18 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c Nov 03 12:13:18 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:18 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4b54fc15-a06e-41b2-9948-6dc2ecab257c" returned: 0 in 0.561s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4b54fc15-a06e-41b2-9948-6dc2ecab257c" released by "delete_volume" :: held 1.196s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['234ea8c3-1c41-4957-8f20-b60dacd69ca3', '58944f06-aa6c-4100-8f8c-e20c375c9ab9', '71e9bf57-63d0-4a7c-9555-fbb00cad54f8', '75c1771e-9fb1-43ce-ad89-868e9eefbaad'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:19 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:19 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Flow 'volume_create_manager' (4fed4acf-6e67-47ae-b90d-52a3208552ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120d7a2c-b73a-49fb-b069-74f9bec1d499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120d7a2c-b73a-49fb-b069-74f9bec1d499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1142756915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2076f4cc-0850-4476-8a65-4c5a3c6ea42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb6c9ffa4164a21a43e989de451df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:20Z,use_quota=True,user_id='e65f86802b944370ad6d79c6543ebf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042ae22a-0fc9-416d-a232-22ac3ee57545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042ae22a-0fc9-416d-a232-22ac3ee57545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbf40c4-9b65-4727-98c2-69d9d366daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbf40c4-9b65-4727-98c2-69d9d366daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2076f4cc-0850-4476-8a65-4c5a3c6ea42c', 'volume_name': 'volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acebfef-f32c-4fc9-a6cc-91f6d40d9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acebfef-f32c-4fc9-a6cc-91f6d40d9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8aeaa9-1d41-4714-a31a-ecb6f779435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Volume 2076f4cc-0850-4476-8a65-4c5a3c6ea42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c', 'volume_size': 2} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1142756915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2076f4cc-0850-4476-8a65-4c5a3c6ea42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb6c9ffa4164a21a43e989de451df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:20Z,use_quota=True,user_id='e65f86802b944370ad6d79c6543ebf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Creating volume 2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:19 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c 2147483648 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:19 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c 2147483648 Nov 03 12:13:19 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:19 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.618s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:19 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Deleted volume successfully. Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60647296-9405-4aa4-bd11-2a86708df9db tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4b54fc15-a06e-41b2-9948-6dc2ecab257c-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-4755786b-5296-46b3-9793-3c8d0544c992-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4755786b-5296-46b3-9793-3c8d0544c992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Deleting offline snapshot 4755786b-5296-46b3-9793-3c8d0544c992 of volume d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] snapshot_file for this snap is: volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9bda9-48be-432b-9dd6-3f3c81836005]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:20 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:20 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Flow 'volume_create_manager' (88fc4d62-8079-4cd0-8f10-31b9a4a48999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4331618e-f09f-4aad-ae10-08cc0c043db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4331618e-f09f-4aad-ae10-08cc0c043db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1dd6f89-6061-4a6c-8684-df65bf04ad77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5228a83f9c2d40f4ade26d2646351dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:20Z,use_quota=True,user_id='3cfc37840add4f2eab5aa1f8b90bd3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb564e-cb5b-4922-80ca-32fbe76500ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb564e-cb5b-4922-80ca-32fbe76500ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfaca0a-7769-41c4-af99-daea212f4146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfaca0a-7769-41c4-af99-daea212f4146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1dd6f89-6061-4a6c-8684-df65bf04ad77', 'volume_name': 'volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0353f60-bf02-4cd4-a85d-301922247b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0353f60-bf02-4cd4-a85d-301922247b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad7e6ae-1122-4ddd-a18c-a094e35b9dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Volume d1dd6f89-6061-4a6c-8684-df65bf04ad77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77', 'volume_size': 1} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:20 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c 2147483648" returned: 0 in 0.884s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:20 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c Nov 03 12:13:20 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:20 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.602s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6096537-6aca-4166-8b90-c3ab8207cf5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766b187-6c9b-4c3c-b86c-04dd98897084]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:21 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:21 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:21 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1dd6f89-6061-4a6c-8684-df65bf04ad77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5228a83f9c2d40f4ade26d2646351dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:20Z,use_quota=True,user_id='3cfc37840add4f2eab5aa1f8b90bd3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Creating volume d1dd6f89-6061-4a6c-8684-df65bf04ad77 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8aeaa9-1d41-4714-a31a-ecb6f779435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b30c7da-fc05-4fbb-a5be-dcd443a3aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:21 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 1073741824 Nov 03 12:13:21 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Volume volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c (2076f4cc-0850-4476-8a65-4c5a3c6ea42c): created successfully Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b30c7da-fc05-4fbb-a5be-dcd443a3aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Flow 'volume_create_manager' (4fed4acf-6e67-47ae-b90d-52a3208552ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d18b24c7-ace7-4eb3-b6c1-91232ed72f0b tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Created volume successfully. Nov 03 12:13:21 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.741s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:21 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:21 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:21 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 1073741824" returned: 0 in 0.799s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:22 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 Nov 03 12:13:22 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:22 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.691s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:22 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992 Nov 03 12:13:22 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:22 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77" returned: 0 in 0.467s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.275s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad7e6ae-1122-4ddd-a18c-a094e35b9dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4a154c-ca65-4666-85e5-7db993dbe12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Volume volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 (d1dd6f89-6061-4a6c-8684-df65bf04ad77): created successfully Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4a154c-ca65-4666-85e5-7db993dbe12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Flow 'volume_create_manager' (88fc4d62-8079-4cd0-8f10-31b9a4a48999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Creating offline snapshot 5273f446-4441-4a06-8627-5eed0cc7ef35 of volume 2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:13:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d5d71f66-551c-4923-81ba-7386ec138061 tempest-VolumesListAdminTestJSON-410173693 None] Created volume successfully. Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf72a22-d227-45f8-8607-d23968c65d06]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:22 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c Nov 03 12:13:22 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:22 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d.4755786b-5296-46b3-9793-3c8d0544c992" returned: 0 in 0.341s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4755786b-5296-46b3-9793-3c8d0544c992" released by "_delete_snapshot" :: held 2.573s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" released by "delete_snapshot" :: held 2.612s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['52767dd4-ab24-44d6-add3-3ccebbf06b29', '15f1b001-2dac-4c97-afb6-7506fd6ba24d', '25b5a1c7-0f8e-45c5-9aec-784203220ef3', 'b3c59cf0-2a30-408b-8388-1b6a6f29f7d5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Delete snapshot completed successfully. Nov 03 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99503aef-6456-4a75-93f6-7ae09c3b0f2d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4755786b-5296-46b3-9793-3c8d0544c992-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:23 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" returned: 0 in 0.488s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:23 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 2G Nov 03 12:13:23 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-d6096537-6aca-4166-8b90-c3ab8207cf5d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-d6096537-6aca-4166-8b90-c3ab8207cf5d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:23 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 2G" returned: 0 in 0.562s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:23 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 Nov 03 12:13:23 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Acquiring lock "cinder-d1dd6f89-6061-4a6c-8684-df65bf04ad77-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "cinder-d1dd6f89-6061-4a6c-8684-df65bf04ad77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[38495daa-2228-471b-811c-2d867431b3b8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Acquiring lock "cinder-quobyte-d1dd6f89-6061-4a6c-8684-df65bf04ad77" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "cinder-quobyte-d1dd6f89-6061-4a6c-8684-df65bf04ad77" acquired by "delete_volume" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-b23e7bf1-4473-422d-b9ea-7da783ade694-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-b23e7bf1-4473-422d-b9ea-7da783ade694-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52469df-2ccc-4560-81ee-0dcdd2163169]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:23 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:23 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-quobyte-b23e7bf1-4473-422d-b9ea-7da783ade694" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-b23e7bf1-4473-422d-b9ea-7da783ade694" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca62de1-011e-4a80-b0c5-17ddbaa70b80]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:24 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35" returned: 0 in 0.548s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:24 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 is being set with open permissions: ugo+rw Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:24 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 Nov 03 12:13:24 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 Nov 03 12:13:24 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 Nov 03 12:13:24 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d Nov 03 12:13:24 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35" returned: 0 in 0.437s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.625s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:13:24 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info Nov 03 12:13:24 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:24 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77" returned: 0 in 0.902s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:24 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77 Nov 03 12:13:24 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694" returned: 0 in 0.890s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:25 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694 Nov 03 12:13:25 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d1dd6f89-6061-4a6c-8684-df65bf04ad77" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d6096537-6aca-4166-8b90-c3ab8207cf5d" returned: 0 in 0.655s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "cinder-quobyte-d1dd6f89-6061-4a6c-8684-df65bf04ad77" released by "delete_volume" :: held 1.335s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info" returned: 0 in 0.504s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info is being set with open permissions: ugo+rw Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-d6096537-6aca-4166-8b90-c3ab8207cf5d" released by "delete_volume" :: held 1.526s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:25 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info Nov 03 12:13:25 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Created reservations ['780c631d-ae47-4c55-9687-02fb7ac4b650', '1a65f797-c659-4d15-93e1-4cd3c0674ee2', '2ff316fc-2830-450f-b44c-77554e5cfcf2', '9f0a19b1-6a45-466b-840d-3ef26bcf95bf'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['9e065255-6c7f-40bd-b0f5-0bb40e438e77', '1f71e02b-2b34-4208-9c42-4887fb9b1e65', '3add2d67-c3bc-4709-b3ca-f07f2cb12f8d', 'd78422fb-7685-4d93-b91f-f948d70a0f25'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:25 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b23e7bf1-4473-422d-b9ea-7da783ade694" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-b23e7bf1-4473-422d-b9ea-7da783ade694" released by "delete_volume" :: held 1.420s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:25 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.info" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:25 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:25 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:25 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7ba9405b-3ac9-4f63-afa5-68cbfc27ce47 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Create snapshot completed successfully Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Created reservations ['772cb62a-4a52-476c-85d8-2ff06a5365d9', '35f113ef-4e86-489c-9718-eebcb132052a', 'cecc18a5-1c77-400f-bd2e-d1a38d88e828', '97e6f7bd-29eb-46ff-82e2-a7429ca27047'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:25 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:25 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:25 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Deleted volume successfully. Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42456366-fffe-494f-8204-ab4884e7b5f9 tempest-VolumesListAdminTestJSON-410173693 None] Lock "cinder-d1dd6f89-6061-4a6c-8684-df65bf04ad77-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:26 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Deleted volume successfully. Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9889bfd3-4b62-4a31-9bf9-37862382ee3b tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-d6096537-6aca-4166-8b90-c3ab8207cf5d-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:26 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.401s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Deleted volume successfully. Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d79c1e96-09e6-4996-bae4-77efde0bbe45 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-b23e7bf1-4473-422d-b9ea-7da783ade694-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-20c96daf-8853-4e4e-908e-2c2625c7243d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-20c96daf-8853-4e4e-908e-2c2625c7243d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-quobyte-20c96daf-8853-4e4e-908e-2c2625c7243d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-20c96daf-8853-4e4e-908e-2c2625c7243d" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfafc0d-9813-4acc-bc76-1e976a4c47fc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "cinder-5273f446-4441-4a06-8627-5eed0cc7ef35-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-5273f446-4441-4a06-8627-5eed0cc7ef35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "cinder-quobyte-5273f446-4441-4a06-8627-5eed0cc7ef35" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-5273f446-4441-4a06-8627-5eed0cc7ef35" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Deleting offline snapshot 5273f446-4441-4a06-8627-5eed0cc7ef35 of volume 2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:13:26 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d Nov 03 12:13:26 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] snapshot_file for this snap is: volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb27d7-a0ae-4b37-8861-4ec9daa81511]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (09bcb1c1-5d0f-4841-931a-4c6d8854d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded36e56-3e23-40dd-974d-a02f71db8302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded36e56-3e23-40dd-974d-a02f71db8302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328518349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359fa990-6c7a-4e85-8893-e311e6494a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:27Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f8282f-c8a2-4493-9acf-8d264331f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f8282f-c8a2-4493-9acf-8d264331f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463bed6-9985-486b-9ad1-0b1fe79f0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463bed6-9985-486b-9ad1-0b1fe79f0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359fa990-6c7a-4e85-8893-e311e6494a8d', 'volume_name': 'volume-359fa990-6c7a-4e85-8893-e311e6494a8d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41983cf-085e-4bd1-804f-a1b3867db3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41983cf-085e-4bd1-804f-a1b3867db3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a32bee7-2b96-4718-886b-c5885157e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Volume 359fa990-6c7a-4e85-8893-e311e6494a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359fa990-6c7a-4e85-8893-e311e6494a8d', 'volume_size': 1} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328518349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359fa990-6c7a-4e85-8893-e311e6494a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:27Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Creating volume 359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:26 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 Nov 03 12:13:26 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:26 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d 1073741824 Nov 03 12:13:26 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d" returned: 0 in 0.581s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:27 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d Nov 03 12:13:27 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35" returned: 0 in 0.429s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a99c70-4de6-4a6c-a0c5-02c232b1b3ae]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:27 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-20c96daf-8853-4e4e-908e-2c2625c7243d" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-20c96daf-8853-4e4e-908e-2c2625c7243d" released by "delete_volume" :: held 0.934s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:27 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c Nov 03 12:13:27 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d 1073741824" returned: 0 in 0.495s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Created reservations ['02ee153d-ec4f-4789-a6eb-bf20c9f999d0', 'ae5ace15-9b97-4aa5-ac34-f5a192fe773d', '33717971-e1bf-43f8-bed2-66150dd91c2f', '209fe350-9ea3-4b75-a420-b5e2a621cf06'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:27 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:27 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:27 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:27 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a32bee7-2b96-4718-886b-c5885157e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359fa990-6c7a-4e85-8893-e311e6494a8d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464460e5-396f-458e-ae2f-f89a6fcc8e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:27 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" returned: 0 in 0.589s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Volume volume-359fa990-6c7a-4e85-8893-e311e6494a8d (359fa990-6c7a-4e85-8893-e311e6494a8d): created successfully Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464460e5-396f-458e-ae2f-f89a6fcc8e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (09bcb1c1-5d0f-4841-931a-4c6d8854d446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:27 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 Nov 03 12:13:27 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2f199248-50fa-4e4f-89e4-7ae2d3c018fc tempest-VolumesSnapshotTestJSON-955460215 None] Created volume successfully. Nov 03 12:13:27 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Deleted volume successfully. Nov 03 12:13:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f07558e-8c58-4678-ab69-8be228b6d650 tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-20c96daf-8853-4e4e-908e-2c2625c7243d-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:28 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:28 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35 Nov 03 12:13:28 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:28 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c.5273f446-4441-4a06-8627-5eed0cc7ef35" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-5273f446-4441-4a06-8627-5eed0cc7ef35" released by "_delete_snapshot" :: held 1.807s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" released by "delete_snapshot" :: held 1.839s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Created reservations ['d91e904b-2afc-4316-a662-f3eb70af8e10', '2f14ff76-709b-4cd2-90e2-34eadeee19c1', '8c7067db-9ab0-4e5a-8900-cd7fad4c3459', '7be50a7f-0dbb-40ac-9b4d-f8676950ec09'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Delete snapshot completed successfully. Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-167d6f4c-8eaa-4909-ad78-873be610783d tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-5273f446-4441-4a06-8627-5eed0cc7ef35-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-fc8de094-b58d-4b9c-9dba-33c0bb9306e9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-fc8de094-b58d-4b9c-9dba-33c0bb9306e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "cinder-quobyte-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cad02d-36b8-4b90-a2af-beb60e598ebc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "cinder-2076f4cc-0850-4476-8a65-4c5a3c6ea42c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:29 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 Nov 03 12:13:29 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-2076f4cc-0850-4476-8a65-4c5a3c6ea42c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Creating offline snapshot e147e210-8586-4ec2-aae2-b57c4311c4f4 of volume 359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e91dc44-0c8d-4a03-a9e4-c71cb8227abb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34c4cc8-63c9-4622-bb9e-8c6a7f1e675b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c Nov 03 12:13:29 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" returned: 0 in 0.564s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:29 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9 Nov 03 12:13:29 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" returned: 0 in 0.439s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c Nov 03 12:13:29 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.465s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" returned: 0 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:29 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 1G Nov 03 12:13:29 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-quobyte-fc8de094-b58d-4b9c-9dba-33c0bb9306e9" released by "delete_volume" :: held 0.987s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Created reservations ['ee43fc59-eea8-4e27-953d-623bf6975340', '89c41947-c418-4e8a-a40d-ac6862306f37', 'f70abe8a-fa5e-4c6a-a4bb-c9b5f6769ef8', 'bff876a9-f696-4ba3-a801-ec5fd547fb52'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:29 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:30 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-quobyte-2076f4cc-0850-4476-8a65-4c5a3c6ea42c" released by "delete_volume" :: held 0.864s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:30 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Created reservations ['be1ade02-617e-4bf1-9a3f-04504550fdf7', '3ec649e8-abf1-4f95-bcbb-7971d512e7ca', 'e6a33dee-35fb-44f1-8a09-1af7e39fccc7', '202ed90b-938e-49fc-b3f8-3385a2473cec'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:30 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:30 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:30 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Deleted volume successfully. Nov 03 12:13:30 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 1G" returned: 0 in 0.688s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359fa990-6c7a-4e85-8893-e311e6494a8d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bf5745b-1328-4599-8f9e-5a7fda45911f tempest-VolumesListAdminTestJSON-2112525977 None] Lock "cinder-fc8de094-b58d-4b9c-9dba-33c0bb9306e9-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:30 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359fa990-6c7a-4e85-8893-e311e6494a8d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:30 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:30 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Deleted volume successfully. Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-664ab796-b015-4926-96cf-669c1c334d57 tempest-VolumesSnapshotNegativeTestJSON-1454601872 None] Lock "cinder-2076f4cc-0850-4476-8a65-4c5a3c6ea42c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:30 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359fa990-6c7a-4e85-8893-e311e6494a8d -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 is being set with open permissions: ugo+rw Nov 03 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:30 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:30 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:31 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.272s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:31 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info Nov 03 12:13:31 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:31 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info" returned: 0 in 0.393s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:31 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info is being set with open permissions: ugo+rw Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:31 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info Nov 03 12:13:31 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:31 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.info" returned: 0 in 0.344s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-99cf79f1-92cb-42cd-a777-608cd1350e35 tempest-VolumesSnapshotTestJSON-955460215 None] Create snapshot completed successfully Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (b9de6769-c961-48a5-8d8b-3cbaa6e7f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aaea97-eb58-4844-9cbf-92469753bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aaea97-eb58-4844-9cbf-92469753bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1465058380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a633f-743e-477c-9568-3d80a6e779e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7d45a128574cac8226cc20d57491f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e147e210-8586-4ec2-aae2-b57c4311c4f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:33Z,use_quota=True,user_id='8847e5316b264c6eb2c7ce53315942d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41238670-d934-45d9-a1b4-fc77092a99bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41238670-d934-45d9-a1b4-fc77092a99bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877a8986-cd44-4b01-8b12-88416bbb6463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877a8986-cd44-4b01-8b12-88416bbb6463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f03a633f-743e-477c-9568-3d80a6e779e5', 'volume_name': 'volume-f03a633f-743e-477c-9568-3d80a6e779e5', 'volume_size': 1, 'snapshot_id': 'e147e210-8586-4ec2-aae2-b57c4311c4f4'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d2f8c6-8f40-4532-af2e-c259956ca373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d2f8c6-8f40-4532-af2e-c259956ca373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e25b87-3780-4983-9d62-45ef312a4038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Volume f03a633f-743e-477c-9568-3d80a6e779e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f03a633f-743e-477c-9568-3d80a6e779e5', 'volume_size': 1, 'snapshot_id': 'e147e210-8586-4ec2-aae2-b57c4311c4f4'} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4-f03a633f-743e-477c-9568-3d80a6e779e5" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4-f03a633f-743e-477c-9568-3d80a6e779e5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Creating volume f03a633f-743e-477c-9568-3d80a6e779e5 from snapshot e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] snapshot: e147e210-8586-4ec2-aae2-b57c4311c4f4, volume: f03a633f-743e-477c-9568-3d80a6e779e5, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[af18bf7e-c6db-4d31-8228-6b68bacae912]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:33 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:33 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:33 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-359fa990-6c7a-4e85-8893-e311e6494a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccedd5-1a4a-4805-8e15-e81b0ef275b9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:34 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:34 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:34 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.445s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:34 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 Nov 03 12:13:34 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (87a1d88e-980c-4c18-894c-351d5c2d4408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d08b6f-8f81-44f8-ade9-ae75ce902382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d08b6f-8f81-44f8-ade9-ae75ce902382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077356786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:35Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a835e5a8-09bd-42cd-ba86-6633e6c79e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a835e5a8-09bd-42cd-ba86-6633e6c79e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83defe1c-4e32-47fa-bc07-90272955b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83defe1c-4e32-47fa-bc07-90272955b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7', 'volume_name': 'volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde08848-b6b4-402a-828c-eabfa6824267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde08848-b6b4-402a-828c-eabfa6824267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ade98e-a7d3-4c37-808e-5130e97104ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7', 'volume_size': 1} Nov 03 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Flow 'volume_create_manager' (6110e52c-eee7-4bab-8694-47a10911b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b483e8a-008b-45b0-b5b2-d600ebfe0660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b483e8a-008b-45b0-b5b2-d600ebfe0660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1342796943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07633339-14df-4c1d-b7ff-7e6611cd835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba35a0494564b83b89cb5765bda6983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:39Z,use_quota=True,user_id='435ec474b1db4bc2b0d92288697c514b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db71dc-4f47-4021-9f87-e9dd6d10d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db71dc-4f47-4021-9f87-e9dd6d10d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160d8aa6-b969-444d-b94f-716e496935e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160d8aa6-b969-444d-b94f-716e496935e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07633339-14df-4c1d-b7ff-7e6611cd835f', 'volume_name': 'volume-07633339-14df-4c1d-b7ff-7e6611cd835f', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd407aa-7250-4a0e-8be2-d261b27163b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd407aa-7250-4a0e-8be2-d261b27163b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3231a7-ecfa-4b95-8efe-75204e1fb708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Volume 07633339-14df-4c1d-b7ff-7e6611cd835f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07633339-14df-4c1d-b7ff-7e6611cd835f', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Trying to clone 07633339-14df-4c1d-b7ff-7e6611cd835f from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:13:40 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:13:40 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:13:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[05862d88-a4cc-4bfb-abf9-09ef02a33fcf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:40 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD Nov 03 12:13:40 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:41 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:41 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 is fetched for user 435ec474b1db4bc2b0d92288697c514b. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:13:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e3e5a-d105-41ec-b5ad-4f68b2d2e182]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:41 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD Nov 03 12:13:41 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:42 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:42 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5" returned: 0 in 8.212s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:13:42 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Converted 1024.00 MB image at 124.68 MB/s Nov 03 12:13:42 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 is being set with open permissions: ugo+rw Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:42 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 Nov 03 12:13:42 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:42 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" released by "_copy_volume_from_snapshot" :: held 9.476s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4-f03a633f-743e-477c-9568-3d80a6e779e5" released by "_create_volume_from_snapshot" :: held 9.595s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.619s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.160s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077356786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:35Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:43 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 1073741824 Nov 03 12:13:43 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e25b87-3780-4983-9d62-45ef312a4038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03a633f-743e-477c-9568-3d80a6e779e5', 'volume_size': 1, 'snapshot_id': 'e147e210-8586-4ec2-aae2-b57c4311c4f4'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9d8056-bd99-4efd-8635-30a8397a68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Volume volume-f03a633f-743e-477c-9568-3d80a6e779e5 (f03a633f-743e-477c-9568-3d80a6e779e5): created successfully Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9d8056-bd99-4efd-8635-30a8397a68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Flow 'volume_create_manager' (b9de6769-c961-48a5-8d8b-3cbaa6e7f572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fcef263b-fb02-475d-b62b-cb7a41f0daef tempest-VolumesSnapshotTestJSON-955460215 None] Created volume successfully. Nov 03 12:13:43 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 1073741824" returned: 0 in 0.605s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:43 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 Nov 03 12:13:43 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:43 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1342796943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07633339-14df-4c1d-b7ff-7e6611cd835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba35a0494564b83b89cb5765bda6983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:39Z,use_quota=True,user_id='435ec474b1db4bc2b0d92288697c514b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Creating volume 07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ade98e-a7d3-4c37-808e-5130e97104ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979f103-5f41-4c3d-8ea0-2f8f10819123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:43 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1073741824 Nov 03 12:13:43 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 (fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7): created successfully Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979f103-5f41-4c3d-8ea0-2f8f10819123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (87a1d88e-980c-4c18-894c-351d5c2d4408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2e6b37e3-dbab-47c6-aa91-e0cb9c05e6a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-f03a633f-743e-477c-9568-3d80a6e779e5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-f03a633f-743e-477c-9568-3d80a6e779e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45de624-8d9f-4653-a4dc-71cf73fbae0b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:44 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 Nov 03 12:13:44 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:44 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1073741824" returned: 0 in 0.573s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:44 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f Nov 03 12:13:44 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:44 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5" returned: 0 in 0.534s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:44 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:44 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5 Nov 03 12:13:44 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:44 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Attempting download of c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 07633339-14df-4c1d-b7ff-7e6611cd835f. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4652da-7b89-43db-86b0-a968a3ddc5e6]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating offline snapshot 823ca432-1da1-46f3-8d23-5d205ec4d615 of volume fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:13:45 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn Nov 03 12:13:45 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5c5341-7846-4de0-b84f-bc3b3d8cdef0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:45 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f03a633f-743e-477c-9568-3d80a6e779e5" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-f03a633f-743e-477c-9568-3d80a6e779e5" released by "delete_volume" :: held 1.002s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:45 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 Nov 03 12:13:45 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['4ee7372f-a783-41d7-b8f1-e9259f651ad0', '9fe88dde-63d5-47fa-aa0f-e93de472fc1e', 'f62369b5-8017-4756-b2e1-2f79f5bef613', '27c8663b-8b69-4628-96b9-9ac33a5bc642'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:45 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn" returned: 0 in 0.427s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:45 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:45 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:45 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn Nov 03 12:13:45 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:45 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" returned: 0 in 0.484s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:45 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 1G Nov 03 12:13:45 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:45 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Deleted volume successfully. Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68c550d6-0124-4ea5-bb45-97139aa2f88a tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-f03a633f-743e-477c-9568-3d80a6e779e5-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:45 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn" returned: 1 in 0.469s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326__hv1lctn' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f2d897-9497-4095-b34e-54975e82e6e5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:46 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD Nov 03 12:13:46 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:46 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 1G" returned: 0 in 0.508s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:46 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 Nov 03 12:13:46 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:46 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:46 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f Nov 03 12:13:46 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-e147e210-8586-4ec2-aae2-b57c4311c4f4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:46 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615" returned: 0 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 is being set with open permissions: ugo+rw Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-e147e210-8586-4ec2-aae2-b57c4311c4f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:46 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 Nov 03 12:13:46 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Deleting offline snapshot e147e210-8586-4ec2-aae2-b57c4311c4f4 of volume 359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] snapshot_file for this snap is: volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7334679-2f3a-47d9-9df2-2ca16de20d53]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:46 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:46 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:46 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:47 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info Nov 03 12:13:47 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:47 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.503s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-359fa990-6c7a-4e85-8893-e311e6494a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb0ed0-c71f-4122-a50f-b62fe836ea26]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:47 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info" returned: 0 in 0.355s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info is being set with open permissions: ugo+rw Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:47 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:47 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:47 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info Nov 03 12:13:47 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:47 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.info" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f4537570-8315-44e8-a061-1158129419a6 req-c1e4a4c2-fff5-4b15-ab84-fe6bc2aa3221 tempest-AttachVolumeNegativeTest-67719601 None] Terminate volume connection completed successfully. Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-f4537570-8315-44e8-a061-1158129419a6 req-c1e4a4c2-fff5-4b15-ab84-fe6bc2aa3221 tempest-AttachVolumeNegativeTest-67719601 None] Deleting attachment a8f51fec-7093-4966-835c-bcfcf88f2e07. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:13:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-219daf5d-ff84-40be-92c5-3e013c08b27a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Create snapshot completed successfully Nov 03 12:13:47 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.719s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:48 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:48 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:48 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:48 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4 Nov 03 12:13:48 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:48 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d.e147e210-8586-4ec2-aae2-b57c4311c4f4" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:48 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-e147e210-8586-4ec2-aae2-b57c4311c4f4" released by "_delete_snapshot" :: held 2.151s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f" returned: 0 in 2.541s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_pi9l2lffdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:13:48 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Converted 112.00 MB image at 44.07 MB/s Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" released by "delete_snapshot" :: held 2.221s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:48 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1G Nov 03 12:13:48 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['927de87a-ce61-446f-8c90-f828daf0b389', '9639ce93-8396-4d19-9d6c-a08b7f7d3bb3', '2b3ca919-5e75-44ed-a31b-50aeda87de16', 'd88daa15-e234-40b4-af5e-84ae5fb701a8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:48 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (96f93314-e087-4ff8-af82-4e8f8df0f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cec4b3-2ad9-44bb-9211-cbea32e3c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cec4b3-2ad9-44bb-9211-cbea32e3c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906996002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9fb948-d607-4ae6-99e4-80154ee3fc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:49Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df474762-6056-43ad-b0b4-6dd4fb611def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df474762-6056-43ad-b0b4-6dd4fb611def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d5d79b-4e58-4097-a571-2d8f1ce6fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d5d79b-4e58-4097-a571-2d8f1ce6fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9fb948-d607-4ae6-99e4-80154ee3fc76', 'volume_name': 'volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f82475e-8d9f-4bd1-b996-02d195dcc5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f82475e-8d9f-4bd1-b996-02d195dcc5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe430ce-bc78-4eb7-964a-c4ddd3382f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume ab9fb948-d607-4ae6-99e4-80154ee3fc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76', 'volume_size': 1} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906996002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9fb948-d607-4ae6-99e4-80154ee3fc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:49Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume ab9fb948-d607-4ae6-99e4-80154ee3fc76 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:49 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 1073741824 Nov 03 12:13:49 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Delete snapshot completed successfully. Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b50c0438-2855-42c0-98ba-f5a85d2b7d46 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-e147e210-8586-4ec2-aae2-b57c4311c4f4-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:49 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f 1G" returned: 0 in 0.584s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Downloaded image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 07633339-14df-4c1d-b7ff-7e6611cd835f successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 for user 435ec474b1db4bc2b0d92288697c514b is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Marking volume 07633339-14df-4c1d-b7ff-7e6611cd835f as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Copying metadata from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 to 07633339-14df-4c1d-b7ff-7e6611cd835f. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Creating volume glance metadata for volume 07633339-14df-4c1d-b7ff-7e6611cd835f backed by image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (ab4826df-f06a-4c79-b1f0-668d00c7bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b46a29-b6bf-4f4f-8ff8-d2d9ff42b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b46a29-b6bf-4f4f-8ff8-d2d9ff42b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011175324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b06640-0aa7-466f-9813-b66d1468e2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:50Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a35bea3-d525-4c7d-aa79-14a24f9a96bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a35bea3-d525-4c7d-aa79-14a24f9a96bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b3573-734a-478f-a356-0cf4162e0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b3573-734a-478f-a356-0cf4162e0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b06640-0aa7-466f-9813-b66d1468e2b6', 'volume_name': 'volume-81b06640-0aa7-466f-9813-b66d1468e2b6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12944343-992d-4a74-96ee-297b62cc8edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12944343-992d-4a74-96ee-297b62cc8edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d774cb80-a1ad-40d7-a557-9d698cc7117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume 81b06640-0aa7-466f-9813-b66d1468e2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b06640-0aa7-466f-9813-b66d1468e2b6', 'volume_size': 1} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 1073741824" returned: 0 in 0.902s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-359fa990-6c7a-4e85-8893-e311e6494a8d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-359fa990-6c7a-4e85-8893-e311e6494a8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3231a7-ecfa-4b95-8efe-75204e1fb708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07633339-14df-4c1d-b7ff-7e6611cd835f', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8b4a3-4e22-44fb-953b-979ca9198742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Volume volume-07633339-14df-4c1d-b7ff-7e6611cd835f (07633339-14df-4c1d-b7ff-7e6611cd835f): created successfully Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8b4a3-4e22-44fb-953b-979ca9198742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Flow 'volume_create_manager' (6110e52c-eee7-4bab-8694-47a10911b0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:50 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 Nov 03 12:13:50 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-77223411-f584-4be3-b983-14aa19620eb1 tempest-VolumesImageMetadata-1177159445 None] Created volume successfully. Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3b31a-b727-45df-951f-3dfb1a1f6536]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (798fb66e-ef85-4cf0-a0a9-39319104fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396a48a-b9b5-42ea-ab74-675f821c9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76" returned: 0 in 0.508s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011175324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b06640-0aa7-466f-9813-b66d1468e2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:50Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:50 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume 81b06640-0aa7-466f-9813-b66d1468e2b6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:50 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396a48a-b9b5-42ea-ab74-675f821c9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889004445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c3c373-1c08-4303-9580-050fc2270689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:50Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 1073741824 Nov 03 12:13:50 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7402e43-2f0b-4e84-8467-dab9d560419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7402e43-2f0b-4e84-8467-dab9d560419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231559bb-540e-47f8-a0f0-7b83c95552e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231559bb-540e-47f8-a0f0-7b83c95552e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c3c373-1c08-4303-9580-050fc2270689', 'volume_name': 'volume-38c3c373-1c08-4303-9580-050fc2270689', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d64d514-83be-4b0a-9f54-a5bc3f99d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d64d514-83be-4b0a-9f54-a5bc3f99d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58805170-e203-4306-a063-c6e530b2ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume 38c3c373-1c08-4303-9580-050fc2270689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c3c373-1c08-4303-9580-050fc2270689', 'volume_size': 1} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe430ce-bc78-4eb7-964a-c4ddd3382f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de50b3a4-2f3b-4ba4-b683-eb7153888829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 (ab9fb948-d607-4ae6-99e4-80154ee3fc76): created successfully Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de50b3a4-2f3b-4ba4-b683-eb7153888829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (96f93314-e087-4ff8-af82-4e8f8df0f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1750af05-9a38-40b1-bb25-3e461ff29d6a tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:51 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.806s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:51 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d Nov 03 12:13:51 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:51 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 1073741824" returned: 0 in 0.870s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (974151ce-e13b-4e72-97c5-2ff298429357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa47d5-1c73-43f9-bcbe-e6d83524ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:51 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa47d5-1c73-43f9-bcbe-e6d83524ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450061682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ddc67-6184-46e1-857e-7a7f8c775a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:51Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04aa8cc-fc75-4dcf-bd6a-d36aec9336cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04aa8cc-fc75-4dcf-bd6a-d36aec9336cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e05468-dd6e-4e8b-893d-5f375e0630c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e05468-dd6e-4e8b-893d-5f375e0630c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557ddc67-6184-46e1-857e-7a7f8c775a96', 'volume_name': 'volume-557ddc67-6184-46e1-857e-7a7f8c775a96', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960f2ca8-1c72-42e1-8bb7-4967b3abf35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960f2ca8-1c72-42e1-8bb7-4967b3abf35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db82432-16b3-43c8-a0a4-786fb60c4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume 557ddc67-6184-46e1-857e-7a7f8c775a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557ddc67-6184-46e1-857e-7a7f8c775a96', 'volume_size': 1} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-359fa990-6c7a-4e85-8893-e311e6494a8d" returned: 0 in 0.531s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-359fa990-6c7a-4e85-8893-e311e6494a8d" released by "delete_volume" :: held 1.445s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Acquiring lock "cinder-07633339-14df-4c1d-b7ff-7e6611cd835f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "cinder-07633339-14df-4c1d-b7ff-7e6611cd835f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:51 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 Nov 03 12:13:51 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Acquiring lock "cinder-quobyte-07633339-14df-4c1d-b7ff-7e6611cd835f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['d1044778-e8bd-4539-a6ab-e92f1f825c50', '2c6b87ec-8ec4-42d5-b438-e33fb26e310f', '1552ed4f-cd13-4caf-9013-9f1a6622fd1f', '6bc7fdaa-acd1-45c3-95c0-f46953549ffd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "cinder-quobyte-07633339-14df-4c1d-b7ff-7e6611cd835f" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d48da40-53d1-4cf9-b363-3e4785d8ab21]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:52 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:52 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:52 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f Nov 03 12:13:52 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:52 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6" returned: 0 in 0.407s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.290s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889004445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c3c373-1c08-4303-9580-050fc2270689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:50Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume 38c3c373-1c08-4303-9580-050fc2270689 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d774cb80-a1ad-40d7-a557-9d698cc7117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b06640-0aa7-466f-9813-b66d1468e2b6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 1073741824 Nov 03 12:13:52 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafe537c-284d-40e1-a688-392dc1486082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-81b06640-0aa7-466f-9813-b66d1468e2b6 (81b06640-0aa7-466f-9813-b66d1468e2b6): created successfully Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafe537c-284d-40e1-a688-392dc1486082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (ab4826df-f06a-4c79-b1f0-668d00c7bd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fb65cda2-4a51-4e7c-b780-597ddc210d12 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (958e4c9f-5e76-4e83-8a1c-96a8d1c98b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aa39f3-e0c5-484c-bab4-8acd266a0998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aa39f3-e0c5-484c-bab4-8acd266a0998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-931697830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cad4ca6-830e-4ee6-8c7a-2543eafca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:52Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73274ae8-fe18-4649-ae2f-3e3d1f1f3618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73274ae8-fe18-4649-ae2f-3e3d1f1f3618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f356d0c-f75f-414b-a387-101567bf8a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f356d0c-f75f-414b-a387-101567bf8a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cad4ca6-830e-4ee6-8c7a-2543eafca448', 'volume_name': 'volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415ad61e-cd5d-4ef3-938b-68514c583a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415ad61e-cd5d-4ef3-938b-68514c583a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2722416d-da4f-4427-8ae6-ada0ad38ab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume 3cad4ca6-830e-4ee6-8c7a-2543eafca448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448', 'volume_size': 1} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:52 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.384s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Deleted volume successfully. Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44da2363-e006-4794-adbe-49129b24166d tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-359fa990-6c7a-4e85-8893-e311e6494a8d-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:52 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f" returned: 0 in 0.561s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:52 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f Nov 03 12:13:52 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-4fde2617-b597-43c5-bb0e-2d8a6609c505-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4fde2617-b597-43c5-bb0e-2d8a6609c505-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:52 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 1073741824" returned: 0 in 0.679s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f66bf-647c-4a2e-b76b-c5a236a17511]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:52 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-07633339-14df-4c1d-b7ff-7e6611cd835f" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "cinder-quobyte-07633339-14df-4c1d-b7ff-7e6611cd835f" released by "delete_volume" :: held 1.014s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:52 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 Nov 03 12:13:52 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Created reservations ['cbc1a8df-5413-47dd-b8ed-b6ef7623e919', '9cf87d0b-1f6e-4a7d-99ac-f30b2840abd2', 'd5e7ce2b-d3ea-48ac-8852-37c0c4407a32', 'bc0d00bc-6e06-4ff3-a50d-72addad7462e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:52 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 Nov 03 12:13:52 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:53 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:53 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:53 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689" returned: 0 in 0.333s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450061682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ddc67-6184-46e1-857e-7a7f8c775a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:51Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume 557ddc67-6184-46e1-857e-7a7f8c775a96 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:53 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505" returned: 0 in 0.456s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:53 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 1073741824 Nov 03 12:13:53 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58805170-e203-4306-a063-c6e530b2ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c3c373-1c08-4303-9580-050fc2270689', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:53 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505 Nov 03 12:13:53 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d70455-fb0a-474a-859a-fe343ab966cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-38c3c373-1c08-4303-9580-050fc2270689 (38c3c373-1c08-4303-9580-050fc2270689): created successfully Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d70455-fb0a-474a-859a-fe343ab966cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (798fb66e-ef85-4cf0-a0a9-39319104fde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c2ee00c0-74ec-4260-a115-f96d8eac860d tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:53 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.462s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Deleted volume successfully. Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-47c225a2-04eb-436a-a054-2dd01f820271 tempest-VolumesImageMetadata-1177159445 None] Lock "cinder-07633339-14df-4c1d-b7ff-7e6611cd835f-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:53 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4fde2617-b597-43c5-bb0e-2d8a6609c505" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-quobyte-4fde2617-b597-43c5-bb0e-2d8a6609c505" released by "delete_volume" :: held 0.909s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Created reservations ['fd90acaa-8f1e-4d5d-9997-1923e01c07a9', '7315af1a-4f2c-44d2-b054-56962c52cbd7', '8253710d-487c-41a8-86e6-13b2f15a4e7d', '2caa08ac-5be8-42a7-b2d3-3b12e6d7c0b9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:53 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 1073741824" returned: 0 in 0.603s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:53 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:53 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:53 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 Nov 03 12:13:53 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:54 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.308s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Deleted volume successfully. Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-68b62d9c-5698-4c75-8a0f-fd64cd181099 tempest-VolumesSnapshotTestJSON-955460215 None] Lock "cinder-4fde2617-b597-43c5-bb0e-2d8a6609c505-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:54 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96" returned: 0 in 0.336s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-931697830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cad4ca6-830e-4ee6-8c7a-2543eafca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d83cc4e8c14d3ab315800f494275a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:13:52Z,use_quota=True,user_id='c87b216ebb5149a3938bf0b27ccef60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Creating volume 3cad4ca6-830e-4ee6-8c7a-2543eafca448 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:13:54 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db82432-16b3-43c8-a0a4-786fb60c4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557ddc67-6184-46e1-857e-7a7f8c775a96', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:54 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 1073741824 Nov 03 12:13:54 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c112ae-88b7-4f56-a2b1-8b4b0b9f2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-557ddc67-6184-46e1-857e-7a7f8c775a96 (557ddc67-6184-46e1-857e-7a7f8c775a96): created successfully Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c112ae-88b7-4f56-a2b1-8b4b0b9f2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (974151ce-e13b-4e72-97c5-2ff298429357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bd1a80bd-34df-4543-a938-9b66f644b192 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:54 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 1073741824" returned: 0 in 0.597s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:54 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 Nov 03 12:13:54 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:55 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2722416d-da4f-4427-8ae6-ada0ad38ab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb2b8b0-50d6-417f-bbbd-2aa1fe2bb489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:13:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Volume volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 (3cad4ca6-830e-4ee6-8c7a-2543eafca448): created successfully Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb2b8b0-50d6-417f-bbbd-2aa1fe2bb489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Flow 'volume_create_manager' (958e4c9f-5e76-4e83-8a1c-96a8d1c98b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:13:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0028314d-cfd7-4e96-aea0-d32758cd58f2 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created volume successfully. Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-3cad4ca6-830e-4ee6-8c7a-2543eafca448-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-3cad4ca6-830e-4ee6-8c7a-2543eafca448-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-3cad4ca6-830e-4ee6-8c7a-2543eafca448" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-3cad4ca6-830e-4ee6-8c7a-2543eafca448" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a717649-d98e-455b-a8c1-b75299e3a965]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:56 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 Nov 03 12:13:56 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:56 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448" returned: 0 in 0.428s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:56 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448 Nov 03 12:13:56 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:56 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3cad4ca6-830e-4ee6-8c7a-2543eafca448" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-3cad4ca6-830e-4ee6-8c7a-2543eafca448" released by "delete_volume" :: held 0.849s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=180,cinder:UPDATE=201,cinder:INSERT=48,cinder:DELETE=20 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=203,cinder:DELETE=18,cinder:SELECT=155,cinder:INSERT=60 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['daf8ff55-9622-4aeb-8355-31161f9fe2f8', '974e369c-60fa-426e-907d-1bb48a6cdf5b', '29b951a6-a926-4ba1-9e3a-ad692b592d3b', 'a3d3845a-05a8-4df5-b9db-6d781a7ff945'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:56 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:56 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-557ddc67-6184-46e1-857e-7a7f8c775a96-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-557ddc67-6184-46e1-857e-7a7f8c775a96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-557ddc67-6184-46e1-857e-7a7f8c775a96" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-557ddc67-6184-46e1-857e-7a7f8c775a96" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[022afd89-eb69-4a3a-bed8-3fd6aecc6560]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:57 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef6cebb2-03e5-4c24-8ab6-0b5e7c8615c9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-3cad4ca6-830e-4ee6-8c7a-2543eafca448-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:57 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 Nov 03 12:13:57 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:57 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96" returned: 0 in 0.509s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:57 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96 Nov 03 12:13:57 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:58 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-557ddc67-6184-46e1-857e-7a7f8c775a96" returned: 0 in 0.342s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-557ddc67-6184-46e1-857e-7a7f8c775a96" released by "delete_volume" :: held 0.922s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['2ed840c1-481d-4652-9fb0-a3d26a60aff0', '19025075-5aea-4153-8ab4-0cd057201669', 'edaec03c-f73c-4649-add6-58b206f76052', 'ff5554e2-536f-4351-b8db-2fab519c3dab'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:58 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:58 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-38c3c373-1c08-4303-9580-050fc2270689-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-38c3c373-1c08-4303-9580-050fc2270689-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-38c3c373-1c08-4303-9580-050fc2270689" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-38c3c373-1c08-4303-9580-050fc2270689" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7124d871-8160-476c-905d-5881771916f1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:58 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 Nov 03 12:13:58 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:58 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.556s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:13:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:13:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2970354-af8e-48d7-bef9-9899074dfc9b tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-557ddc67-6184-46e1-857e-7a7f8c775a96-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:59 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689" returned: 0 in 0.606s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:59 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689 Nov 03 12:13:59 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:13:59 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-38c3c373-1c08-4303-9580-050fc2270689" returned: 0 in 0.351s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-38c3c373-1c08-4303-9580-050fc2270689" released by "delete_volume" :: held 1.056s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['f8b6929a-4478-416e-9151-1c5ac09a3663', 'ba0d4215-90ea-4668-8e60-56b832b6b972', 'a6121b3f-26dc-49c6-bbd1-150ecc7493b5', '789b694f-8377-4f98-9804-b6a2df2bc2ad'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:13:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:13:59 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:13:59 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:00 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.336s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-67c30f16-a22b-40a6-a7fb-4572734ecced tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-38c3c373-1c08-4303-9580-050fc2270689-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Flow 'volume_create_manager' (68354adc-9ab2-4c76-820b-59b6f8dfb4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fde6ee0-4579-4b68-953a-ce148cae0f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fde6ee0-4579-4b68-953a-ce148cae0f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1742483013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56d6ce1-e70c-47ce-81a7-ace52ec663b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5797d7ae6e42c0a8589a75b73a7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:00Z,use_quota=True,user_id='5f293582a5054639aab392eab233a924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ff4e0f-f06e-4195-8902-746cddb5759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ff4e0f-f06e-4195-8902-746cddb5759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ce3f8d-0ab5-4993-905a-194402ac7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ce3f8d-0ab5-4993-905a-194402ac7217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56d6ce1-e70c-47ce-81a7-ace52ec663b8', 'volume_name': 'volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2fcaee-94be-4c76-ad9f-1b640a8325b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2fcaee-94be-4c76-ad9f-1b640a8325b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234906cc-3da5-4c8b-a538-2f57e5de0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Volume e56d6ce1-e70c-47ce-81a7-ace52ec663b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8', 'volume_size': 1} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1742483013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56d6ce1-e70c-47ce-81a7-ace52ec663b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5797d7ae6e42c0a8589a75b73a7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:00Z,use_quota=True,user_id='5f293582a5054639aab392eab233a924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Creating volume e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:00 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 1073741824 Nov 03 12:14:00 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-81b06640-0aa7-466f-9813-b66d1468e2b6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-81b06640-0aa7-466f-9813-b66d1468e2b6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-81b06640-0aa7-466f-9813-b66d1468e2b6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-81b06640-0aa7-466f-9813-b66d1468e2b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec0bcf-e4c1-4306-bafa-eb3b7e565250]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:01 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 1073741824" returned: 0 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:01 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 Nov 03 12:14:01 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:01 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 Nov 03 12:14:01 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:01 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" returned: 0 in 0.494s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:01 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6" returned: 0 in 0.628s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234906cc-3da5-4c8b-a538-2f57e5de0d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5352e203-892b-467d-aa6b-d3464ee67798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:01 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6 Nov 03 12:14:01 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Volume volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 (e56d6ce1-e70c-47ce-81a7-ace52ec663b8): created successfully Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5352e203-892b-467d-aa6b-d3464ee67798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Flow 'volume_create_manager' (68354adc-9ab2-4c76-820b-59b6f8dfb4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-435d0f1b-378e-49da-a3a3-92a7fa8cd988 tempest-SnapshotMetadataTestJSON-482444101 None] Created volume successfully. Nov 03 12:14:01 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-81b06640-0aa7-466f-9813-b66d1468e2b6" returned: 0 in 0.332s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-81b06640-0aa7-466f-9813-b66d1468e2b6" released by "delete_volume" :: held 1.034s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['fd6bbd9d-e22d-46ee-9f6a-f23a1365f49f', '3fb90def-349a-4db6-a7cb-f61bd780a95b', 'd360cdd0-f028-4a30-9cd3-fbac3b2fdb1e', '70f944cc-4cdc-4888-a533-da14d3cc12b4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:02 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:02 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:02 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Creating offline snapshot 5619eb20-ae8f-4429-85c3-f9f79a75f129 of volume e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ebf9813d-4447-4059-9e71-96b0172b6659 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-81b06640-0aa7-466f-9813-b66d1468e2b6-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f436ce-a2a2-4ed5-a68e-aa7c60a106bb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:02 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 Nov 03 12:14:02 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:03 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" returned: 0 in 0.501s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-ab9fb948-d607-4ae6-99e4-80154ee3fc76-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:03 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 1G Nov 03 12:14:03 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-ab9fb948-d607-4ae6-99e4-80154ee3fc76-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-ab9fb948-d607-4ae6-99e4-80154ee3fc76" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-ab9fb948-d607-4ae6-99e4-80154ee3fc76" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02872b7-58c7-46ea-a7e6-e524c33c7e7b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:03 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 Nov 03 12:14:03 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:03 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 1G" returned: 0 in 0.627s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:03 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 Nov 03 12:14:03 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76" returned: 0 in 0.547s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:03 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:03 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76 Nov 03 12:14:03 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:04 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129" returned: 0 in 0.749s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 is being set with open permissions: ugo+rw Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:04 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ab9fb948-d607-4ae6-99e4-80154ee3fc76" returned: 0 in 0.734s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-ab9fb948-d607-4ae6-99e4-80154ee3fc76" released by "delete_volume" :: held 1.351s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:04 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 Nov 03 12:14:04 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['d0f02126-cc7a-4668-b3ac-751f63853b66', '9cf21d03-f03c-4578-8cff-b463edff5a80', '6bcf45ec-c3c0-44ea-97fb-333fbda97c59', '49ff4716-b96d-472a-81fa-ce9d70030100'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:04 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:04 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:04 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129" returned: 0 in 0.483s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:05 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info Nov 03 12:14:05 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:05 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.515s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d083670e-3b90-4633-8917-8a8ff6791f2f tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-ab9fb948-d607-4ae6-99e4-80154ee3fc76-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-823ca432-1da1-46f3-8d23-5d205ec4d615-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-823ca432-1da1-46f3-8d23-5d205ec4d615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:05 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info" returned: 0 in 0.645s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:05 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info is being set with open permissions: ugo+rw Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-823ca432-1da1-46f3-8d23-5d205ec4d615" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:05 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info Nov 03 12:14:05 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-823ca432-1da1-46f3-8d23-5d205ec4d615" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleting offline snapshot 823ca432-1da1-46f3-8d23-5d205ec4d615 of volume fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] snapshot_file for this snap is: volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be19b0-4328-4f5a-ba12-7cf4264fe00f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Flow 'volume_create_manager' (80b7e534-55f8-4504-a7eb-87242a7ca5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb56a13-8775-4725-8421-37b9b6567911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb56a13-8775-4725-8421-37b9b6567911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1687468573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a08481c904446c93277730a94468c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:06Z,use_quota=True,user_id='cfccb3f5354744f2984579e0294fab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737a1df5-0b31-4922-93f6-34b84aab1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737a1df5-0b31-4922-93f6-34b84aab1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3c0e18-0736-44ae-8ff7-b63bbb9443a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:06 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 Nov 03 12:14:06 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3c0e18-0736-44ae-8ff7-b63bbb9443a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1', 'volume_name': 'volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13232582-e660-486c-a5e8-286f0a2de1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13232582-e660-486c-a5e8-286f0a2de1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd11ae89-b6de-4036-b184-24b2fd34ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1', 'volume_size': 1} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:06 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.info" returned: 0 in 0.493s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1687468573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a08481c904446c93277730a94468c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:06Z,use_quota=True,user_id='cfccb3f5354744f2984579e0294fab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Creating volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bcf9a68a-b6cc-4b0c-a626-4359ba70b5f2 tempest-SnapshotMetadataTestJSON-482444101 None] Create snapshot completed successfully Nov 03 12:14:06 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 1073741824 Nov 03 12:14:06 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:06 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615" returned: 0 in 0.589s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e32fe73-cdd9-4698-bc35-8d92fd2990cc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:06 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 Nov 03 12:14:06 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:06 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 1073741824" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:07 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 Nov 03 12:14:07 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:07 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" returned: 0 in 0.561s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:07 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 Nov 03 12:14:07 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:07 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" returned: 0 in 0.399s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd11ae89-b6de-4036-b184-24b2fd34ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef33dd6-cbed-494f-b8af-5afba51e258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Volume volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 (b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1): created successfully Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef33dd6-cbed-494f-b8af-5afba51e258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Flow 'volume_create_manager' (80b7e534-55f8-4504-a7eb-87242a7ca5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-317e9c96-0599-4ee6-b5d9-f5624dbcca4e tempest-VolumesSnapshotListTestJSON-867772669 None] Created volume successfully. Nov 03 12:14:07 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615" returned: 0 in 0.621s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:07 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615 Nov 03 12:14:07 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:08 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7.823ca432-1da1-46f3-8d23-5d205ec4d615" returned: 0 in 0.442s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "cinder-5619eb20-ae8f-4429-85c3-f9f79a75f129-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-823ca432-1da1-46f3-8d23-5d205ec4d615" released by "_delete_snapshot" :: held 2.468s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-5619eb20-ae8f-4429-85c3-f9f79a75f129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" released by "delete_snapshot" :: held 2.533s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "cinder-quobyte-5619eb20-ae8f-4429-85c3-f9f79a75f129" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-5619eb20-ae8f-4429-85c3-f9f79a75f129" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Deleting offline snapshot 5619eb20-ae8f-4429-85c3-f9f79a75f129 of volume e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] snapshot_file for this snap is: volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5951e3d-80be-42d1-a085-864effe8b6bd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['48995db6-b68c-4b25-a01e-d85d865ba4d8', 'bcac322b-6ba5-4db1-96c2-97b2ecf90c5b', 'b364fd9e-93eb-4400-8a8f-756b114e2590', '491e77dd-b9b0-42ba-ae18-65979325d35a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Creating offline snapshot 2ff9c45c-d573-4f50-ad27-c2d12d0840f4 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9009a3b-0374-46cf-b89a-d694b8fed1d1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:08 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 Nov 03 12:14:08 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Delete snapshot completed successfully. Nov 03 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4b033bd8-02b1-45f0-8036-57d651de66f3 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-823ca432-1da1-46f3-8d23-5d205ec4d615-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:08 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 Nov 03 12:14:08 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:09 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d3ab6-dca9-4473-9cff-e11bed67f456]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada20844-cefc-452f-9b47-3c210e7920cd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:09 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:09 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 Nov 03 12:14:09 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:09 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 Nov 03 12:14:09 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:09 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 1G Nov 03 12:14:09 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:09 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" returned: 0 in 0.530s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:09 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 Nov 03 12:14:09 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:09 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" returned: 0 in 0.699s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:09 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7 Nov 03 12:14:09 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:10 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 1G" returned: 0 in 0.661s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:10 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:10 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:10 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129" returned: 0 in 0.513s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:10 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129 Nov 03 12:14:10 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:10 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" returned: 0 in 0.439s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-quobyte-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7" released by "delete_volume" :: held 1.280s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Created reservations ['1b6968be-130c-457c-ad4f-b53735036c9a', '99b06ecf-3039-4e4a-b567-9c0eb87a0bcc', '6a0a4f56-b0c5-4725-83f5-b0678e0c8d00', '2b6dcabf-d6a8-47e9-a5a7-0b15f96ebc71'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:10 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.476s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 is being set with open permissions: ugo+rw Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:10 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:10 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:10 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:10 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:10 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8.5619eb20-ae8f-4429-85c3-f9f79a75f129" returned: 0 in 0.395s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-5619eb20-ae8f-4429-85c3-f9f79a75f129" released by "_delete_snapshot" :: held 2.370s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" released by "delete_snapshot" :: held 2.434s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Created reservations ['0b0a6def-fe0b-460b-979b-69154c156056', 'de3ac007-850e-4c7a-aed3-1a96b80cd96e', 'c815c385-1db7-49a9-83fe-0dbb26796ef6', '864ba901-3d23-41e9-8411-b5cbfaa16d02'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:10 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.351s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Deleted volume successfully. Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad7dd81a-4559-494e-a8a8-926724d789a9 tempest-CreateVolumesFromSnapshotTest-1917862291 None] Lock "cinder-fdcbd146-d4bf-4859-b23b-c9d0e8b8bfd7-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Delete snapshot completed successfully. Nov 03 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6f270f1b-1a88-43f5-9aef-3e6a4596e057 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-5619eb20-ae8f-4429-85c3-f9f79a75f129-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:10 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info Nov 03 12:14:10 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:11 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info is being set with open permissions: ugo+rw Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:11 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info Nov 03 12:14:11 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:11 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.info" returned: 0 in 0.262s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-301909ef-81be-42bb-a990-20cb7a4bd5f5 tempest-VolumesSnapshotListTestJSON-867772669 None] Create snapshot completed successfully Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "cinder-e56d6ce1-e70c-47ce-81a7-ace52ec663b8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-e56d6ce1-e70c-47ce-81a7-ace52ec663b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de761f7a-9468-4c88-8746-b4b36e8bbe2b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:11 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 Nov 03 12:14:11 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Creating offline snapshot 6fcc0396-7928-458f-8d99-93cc3f97f909 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988ebd8-018f-4327-a63b-face45dfa8a0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:12 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" returned: 0 in 0.482s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:12 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:12 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:12 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8 Nov 03 12:14:12 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:12 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" returned: 0 in 0.325s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-quobyte-e56d6ce1-e70c-47ce-81a7-ace52ec663b8" released by "delete_volume" :: held 0.901s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:12 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.514s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:12 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 1G Nov 03 12:14:12 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Created reservations ['a89b4c8f-ec05-4305-af10-f67ae4dcf608', 'a77ca123-5f4a-4245-9eae-941f86135f63', '9de6c767-9c8b-4f57-9d0f-a828d9e80aa8', '7a307953-77b4-4914-996a-29f765a70d35'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:12 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:12 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:13 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.513s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Deleted volume successfully. Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b15b7a0-7c3c-4b25-8d96-443c88d52834 tempest-SnapshotMetadataTestJSON-482444101 None] Lock "cinder-e56d6ce1-e70c-47ce-81a7-ace52ec663b8-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:13 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 1G" returned: 0 in 0.800s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:13 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:13 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:13 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.411s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:13 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 is being set with open permissions: ugo+rw Nov 03 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:13 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:13 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:14 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-45fd0553-389d-4708-b86e-7ae853fb24cc tempest-VolumesSnapshotListTestJSON-867772669 None] Create snapshot completed successfully Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Creating offline snapshot bc3dbace-94e0-401c-ad64-da6bb792ec88 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd68d072-113c-4a33-8545-a410271e4cac]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:15 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:15 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (89923a8e-9ba2-4445-91cc-4f20f89c2821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cfc7c1-b0ad-491b-a6cf-0cb00c46387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cfc7c1-b0ad-491b-a6cf-0cb00c46387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732754294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24d6d69-092a-4249-a035-b7e0a301d0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:16Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c427ec1-97bb-408d-87ff-e3d7435c2a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c427ec1-97bb-408d-87ff-e3d7435c2a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c7a3d4-f365-4998-8bb5-034848fea18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c7a3d4-f365-4998-8bb5-034848fea18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24d6d69-092a-4249-a035-b7e0a301d0c0', 'volume_name': 'volume-a24d6d69-092a-4249-a035-b7e0a301d0c0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a792c69-d1c6-4b5b-a27b-a527d0ebb114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a792c69-d1c6-4b5b-a27b-a527d0ebb114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e847796-1f17-4552-8025-1a47de58f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume a24d6d69-092a-4249-a035-b7e0a301d0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24d6d69-092a-4249-a035-b7e0a301d0c0', 'volume_size': 1} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:15 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.466s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:16 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 1G Nov 03 12:14:16 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:16 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 1G" returned: 0 in 0.593s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:16 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 Nov 03 12:14:16 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:16 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 is being set with open permissions: ugo+rw Nov 03 12:14:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:16 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 Nov 03 12:14:16 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:17 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88" returned: 0 in 0.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732754294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24d6d69-092a-4249-a035-b7e0a301d0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:16Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume a24d6d69-092a-4249-a035-b7e0a301d0c0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:17 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 1073741824 Nov 03 12:14:17 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e6e58b5f-402b-4200-b105-2a810b32685f tempest-VolumesSnapshotListTestJSON-867772669 None] Create snapshot completed successfully Nov 03 12:14:17 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 1073741824" returned: 0 in 0.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:17 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 Nov 03 12:14:17 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:18 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0" returned: 0 in 0.353s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e847796-1f17-4552-8025-1a47de58f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24d6d69-092a-4249-a035-b7e0a301d0c0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a76002-25a9-4ee5-96d5-fd74a7566430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 (a24d6d69-092a-4249-a035-b7e0a301d0c0): created successfully Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a76002-25a9-4ee5-96d5-fd74a7566430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (89923a8e-9ba2-4445-91cc-4f20f89c2821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bfb92dc1-f581-42c7-87eb-10dc6797c709 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-bc3dbace-94e0-401c-ad64-da6bb792ec88-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-bc3dbace-94e0-401c-ad64-da6bb792ec88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-bc3dbace-94e0-401c-ad64-da6bb792ec88" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-bc3dbace-94e0-401c-ad64-da6bb792ec88" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Deleting offline snapshot bc3dbace-94e0-401c-ad64-da6bb792ec88 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] snapshot_file for this snap is: volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[82914308-fcb2-4d8a-b6c2-f24f425ee2ca]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:19 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 Nov 03 12:14:19 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:19 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88" returned: 0 in 0.435s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6878205e-bcbc-4218-88fc-4cd8ca4a7ef1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:19 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:19 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (3734f8fb-4ebc-4011-8a8b-26f20846fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f9f8fe-d736-4a58-981d-01256729b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f9f8fe-d736-4a58-981d-01256729b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073606003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2693c4-356d-45b0-842f-276a3c55446b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:20Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cae6f4-41dd-40fa-b44e-651e4a2fd1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cae6f4-41dd-40fa-b44e-651e4a2fd1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df99c04e-d2f5-4b6e-8880-c4035384ac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:19 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df99c04e-d2f5-4b6e-8880-c4035384ac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2693c4-356d-45b0-842f-276a3c55446b', 'volume_name': 'volume-0d2693c4-356d-45b0-842f-276a3c55446b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14e4c05-367b-4c10-8270-cac05366f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14e4c05-367b-4c10-8270-cac05366f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e158dda-fb7c-495a-be59-aa580bf5802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume 0d2693c4-356d-45b0-842f-276a3c55446b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2693c4-356d-45b0-842f-276a3c55446b', 'volume_size': 1} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073606003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2693c4-356d-45b0-842f-276a3c55446b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:20Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume 0d2693c4-356d-45b0-842f-276a3c55446b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:20 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.538s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:20 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b 1073741824 Nov 03 12:14:20 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:20 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 Nov 03 12:14:20 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (e02c7858-5fb7-449d-9ad5-a150f0012788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d83147e-f61e-489a-9afa-895f69f2bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d83147e-f61e-489a-9afa-895f69f2bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211035551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a91434-90b3-49cd-85e7-6bc57515bc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:20Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa3fdbd-7b24-4b4d-a2bf-ee2eb566811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa3fdbd-7b24-4b4d-a2bf-ee2eb566811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c551771-f3a3-4466-a913-4c8fa23cb6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c551771-f3a3-4466-a913-4c8fa23cb6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a91434-90b3-49cd-85e7-6bc57515bc2e', 'volume_name': 'volume-52a91434-90b3-49cd-85e7-6bc57515bc2e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4ee14a-a685-40fa-b8ca-2c3193e97151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4ee14a-a685-40fa-b8ca-2c3193e97151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7c35d7-3042-4fac-b3c7-79746bfa9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume 52a91434-90b3-49cd-85e7-6bc57515bc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a91434-90b3-49cd-85e7-6bc57515bc2e', 'volume_size': 1} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88" returned: 0 in 0.638s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:20 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88 Nov 03 12:14:20 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (1df5b2d0-769a-4255-92a7-86ddd3a25f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e761dcbb-9fae-4294-9509-823f23f880a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e761dcbb-9fae-4294-9509-823f23f880a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293614677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc469f50-0d7a-4bce-81d8-cb972c52f0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:21Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f91f77-5a01-44a1-bc39-edb43f11d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f91f77-5a01-44a1-bc39-edb43f11d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180e0eff-81ba-4784-a3f2-f89adb6f7a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180e0eff-81ba-4784-a3f2-f89adb6f7a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc469f50-0d7a-4bce-81d8-cb972c52f0e9', 'volume_name': 'volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35aace-1517-4b44-8fae-a8dcd4e9bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35aace-1517-4b44-8fae-a8dcd4e9bc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c7e28-0a41-48d0-ab9e-c2e6732da92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume fc469f50-0d7a-4bce-81d8-cb972c52f0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9', 'volume_size': 1} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b 1073741824" returned: 0 in 0.937s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:21 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b Nov 03 12:14:21 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:21 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.bc3dbace-94e0-401c-ad64-da6bb792ec88" returned: 0 in 0.426s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-bc3dbace-94e0-401c-ad64-da6bb792ec88" released by "_delete_snapshot" :: held 2.204s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" released by "delete_snapshot" :: held 2.238s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (6cb1f4ce-4c06-48b0-bff1-2e716666ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b170c31a-be1b-4a00-b2e1-c0270454f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b170c31a-be1b-4a00-b2e1-c0270454f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2123475003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53622dc-0236-4234-b4ff-f3d0c6298a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:21Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33167056-87b7-4100-a774-7e39f8587f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33167056-87b7-4100-a774-7e39f8587f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef181b2-d430-4a10-b98f-a0b38d8e51a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef181b2-d430-4a10-b98f-a0b38d8e51a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53622dc-0236-4234-b4ff-f3d0c6298a66', 'volume_name': 'volume-c53622dc-0236-4234-b4ff-f3d0c6298a66', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4dad60-a331-41b4-bdfb-31fffa041a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4dad60-a331-41b4-bdfb-31fffa041a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bae97c-aebf-4a03-ba08-5fd80964d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume c53622dc-0236-4234-b4ff-f3d0c6298a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53622dc-0236-4234-b4ff-f3d0c6298a66', 'volume_size': 1} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Created reservations ['3de8f553-1cf6-44ff-b7f3-67e9fbdbc225', 'b2bf4177-6263-4a38-86d9-2b72e85aca64', 'd5678b4b-68c7-4548-bc77-8a05ffd0b929', 'b209511d-670e-4003-af13-5c79718c7243'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:21 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b" returned: 0 in 0.380s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211035551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a91434-90b3-49cd-85e7-6bc57515bc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:20Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume 52a91434-90b3-49cd-85e7-6bc57515bc2e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:21 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e 1073741824 Nov 03 12:14:21 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e158dda-fb7c-495a-be59-aa580bf5802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2693c4-356d-45b0-842f-276a3c55446b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4902d-9830-46e9-a26d-9f7d2a1bb880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-0d2693c4-356d-45b0-842f-276a3c55446b (0d2693c4-356d-45b0-842f-276a3c55446b): created successfully Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4902d-9830-46e9-a26d-9f7d2a1bb880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (3734f8fb-4ebc-4011-8a8b-26f20846fd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Delete snapshot completed successfully. Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a441f16c-3799-486e-a973-779a9413b135 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b7f5e14c-2f31-4243-84d0-b32fda57c5e9 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-bc3dbace-94e0-401c-ad64-da6bb792ec88-delete_snapshot" released by "delete_snapshot" :: held 2.649s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (3d53a052-e21c-49c1-83b4-1a5de70865c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0df691d-ebd1-45ce-ad80-42ca33da579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0df691d-ebd1-45ce-ad80-42ca33da579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529886836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd695c88-80ac-43d3-a8d9-219b93f2effb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:22Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e0e7d1-e625-4306-ad2a-4dc3a80bac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e0e7d1-e625-4306-ad2a-4dc3a80bac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c266bda7-af3e-4faf-8de6-0f9b98d3001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c266bda7-af3e-4faf-8de6-0f9b98d3001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd695c88-80ac-43d3-a8d9-219b93f2effb', 'volume_name': 'volume-cd695c88-80ac-43d3-a8d9-219b93f2effb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae32948e-93cc-4dde-9c1e-714221db8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae32948e-93cc-4dde-9c1e-714221db8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489a7687-825e-4290-81b7-a508136d6174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume cd695c88-80ac-43d3-a8d9-219b93f2effb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd695c88-80ac-43d3-a8d9-219b93f2effb', 'volume_size': 1} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:21 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e 1073741824" returned: 0 in 0.533s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:22 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e Nov 03 12:14:22 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Flow 'volume_create_manager' (90a037ff-a435-407c-be7b-6c246de22c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8213d7-26f7-4f5d-870b-60f041087ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8213d7-26f7-4f5d-870b-60f041087ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1913817970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9009ae52-1ce7-4784-b558-d740bfffd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6540e2f78dbb4d348374c9ea2aa18c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:22Z,use_quota=True,user_id='115715fe689a49c48e61abf301d20651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693e6395-449e-428a-aecb-67402ea2bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693e6395-449e-428a-aecb-67402ea2bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c737a77-0902-4a80-af1b-3103973db0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c737a77-0902-4a80-af1b-3103973db0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9009ae52-1ce7-4784-b558-d740bfffd238', 'volume_name': 'volume-9009ae52-1ce7-4784-b558-d740bfffd238', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6525908-0946-4456-aec2-559e885f38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6525908-0946-4456-aec2-559e885f38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4002810d-a133-499d-97f8-88d1870d066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Volume 9009ae52-1ce7-4784-b558-d740bfffd238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9009ae52-1ce7-4784-b558-d740bfffd238', 'volume_size': 1} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-6fcc0396-7928-458f-8d99-93cc3f97f909-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-6fcc0396-7928-458f-8d99-93cc3f97f909-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-6fcc0396-7928-458f-8d99-93cc3f97f909" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-6fcc0396-7928-458f-8d99-93cc3f97f909" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Deleting offline snapshot 6fcc0396-7928-458f-8d99-93cc3f97f909 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] snapshot_file for this snap is: volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f545b8-d5b8-434f-a2a9-94dbc968ddc2]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:22 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293614677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc469f50-0d7a-4bce-81d8-cb972c52f0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:21Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume fc469f50-0d7a-4bce-81d8-cb972c52f0e9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7c35d7-3042-4fac-b3c7-79746bfa9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a91434-90b3-49cd-85e7-6bc57515bc2e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 1073741824 Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692bce02-092c-4afe-8437-ed1bdd8e560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:22 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-52a91434-90b3-49cd-85e7-6bc57515bc2e (52a91434-90b3-49cd-85e7-6bc57515bc2e): created successfully Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692bce02-092c-4afe-8437-ed1bdd8e560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (e02c7858-5fb7-449d-9ad5-a150f0012788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:22 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:22 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5d587fb9-9f0b-4a07-8839-125488a9ab90 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:22 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac7335c-4c64-462a-aee8-aabe92a41aa8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:22 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 1073741824" returned: 0 in 0.479s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:22 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:22 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:22 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 Nov 03 12:14:22 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2123475003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53622dc-0236-4234-b4ff-f3d0c6298a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:21Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume c53622dc-0236-4234-b4ff-f3d0c6298a66 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:23 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.392s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:23 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 1073741824 Nov 03 12:14:23 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c7e28-0a41-48d0-ab9e-c2e6732da92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0757a6a5-870a-4077-8fc7-f6870498db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:23 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:23 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 (fc469f50-0d7a-4bce-81d8-cb972c52f0e9): created successfully Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0757a6a5-870a-4077-8fc7-f6870498db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (1df5b2d0-769a-4255-92a7-86ddd3a25f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b6f44406-5ae6-460a-809c-f126ec430a10 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:23 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.415s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:23 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 1073741824" returned: 0 in 0.443s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909 Nov 03 12:14:23 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:23 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 Nov 03 12:14:23 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.6fcc0396-7928-458f-8d99-93cc3f97f909" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-6fcc0396-7928-458f-8d99-93cc3f97f909" released by "_delete_snapshot" :: held 1.599s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" released by "delete_snapshot" :: held 1.624s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:23 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529886836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd695c88-80ac-43d3-a8d9-219b93f2effb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ff777fd3234683998c4a1a8c6e8717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:22Z,use_quota=True,user_id='818652aa8a384c8fa229d041ebdd7079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Creating volume cd695c88-80ac-43d3-a8d9-219b93f2effb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bae97c-aebf-4a03-ba08-5fd80964d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53622dc-0236-4234-b4ff-f3d0c6298a66', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:23 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb 1073741824 Nov 03 12:14:23 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d303b85-6770-446a-ad3e-ed5f21322306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 (c53622dc-0236-4234-b4ff-f3d0c6298a66): created successfully Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d303b85-6770-446a-ad3e-ed5f21322306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (6cb1f4ce-4c06-48b0-bff1-2e716666ab92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a884fa47-6fa3-472e-9569-9e181351b456 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Created reservations ['71266db1-49ed-4e12-bc20-996d03be7adf', 'f8f7ebbb-4933-43af-b493-b26a7f34a8c3', '617bd7c3-094d-4f17-b94d-f4fc896cc0d5', '02d6d7a5-b092-4756-bdb2-c2b38b601a3d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Delete snapshot completed successfully. Nov 03 12:14:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c5ee90-2c95-49b9-a558-ab4e81424420 tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-6fcc0396-7928-458f-8d99-93cc3f97f909-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:24 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:24 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:24 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-2ff9c45c-d573-4f50-ad27-c2d12d0840f4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb 1073741824" returned: 0 in 0.481s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-2ff9c45c-d573-4f50-ad27-c2d12d0840f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-2ff9c45c-d573-4f50-ad27-c2d12d0840f4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-2ff9c45c-d573-4f50-ad27-c2d12d0840f4" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Deleting offline snapshot 2ff9c45c-d573-4f50-ad27-c2d12d0840f4 of volume b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:24 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb Nov 03 12:14:24 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:24 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] snapshot_file for this snap is: volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.298s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a67ee-1447-40a9-b07e-8cc5ac2f276f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:24 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:24 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:24 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb" returned: 0 in 0.258s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1913817970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9009ae52-1ce7-4784-b558-d740bfffd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6540e2f78dbb4d348374c9ea2aa18c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:22Z,use_quota=True,user_id='115715fe689a49c48e61abf301d20651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Creating volume 9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489a7687-825e-4290-81b7-a508136d6174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd695c88-80ac-43d3-a8d9-219b93f2effb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:24 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 1073741824 Nov 03 12:14:24 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b38e98-6e2a-499b-9758-5db86bbe7dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Volume volume-cd695c88-80ac-43d3-a8d9-219b93f2effb (cd695c88-80ac-43d3-a8d9-219b93f2effb): created successfully Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b38e98-6e2a-499b-9758-5db86bbe7dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Flow 'volume_create_manager' (3d53a052-e21c-49c1-83b4-1a5de70865c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-84753912-3442-49b3-a07c-fee7b4e66fa5 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created volume successfully. Nov 03 12:14:24 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39aad11-401c-43ef-8ff0-23c6da597e72]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:24 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 Nov 03 12:14:24 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-cd695c88-80ac-43d3-a8d9-219b93f2effb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-cd695c88-80ac-43d3-a8d9-219b93f2effb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-cd695c88-80ac-43d3-a8d9-219b93f2effb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-cd695c88-80ac-43d3-a8d9-219b93f2effb" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf98be4a-d5bb-48a2-b84b-c662aca8d416]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:25 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 1073741824" returned: 0 in 0.543s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:25 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:25 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb Nov 03 12:14:25 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" returned: 0 in 0.478s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:25 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:25 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.329s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4002810d-a133-499d-97f8-88d1870d066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9009ae52-1ce7-4784-b558-d740bfffd238', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d93887-d2bd-43f5-9957-0237d2be5c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Volume volume-9009ae52-1ce7-4784-b558-d740bfffd238 (9009ae52-1ce7-4784-b558-d740bfffd238): created successfully Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d93887-d2bd-43f5-9957-0237d2be5c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:25 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Flow 'volume_create_manager' (90a037ff-a435-407c-be7b-6c246de22c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb" returned: 0 in 0.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-115242dd-ea7f-4a16-8908-bc9e6cc15434 tempest-VolumesCloneTest-16166726 None] Created volume successfully. Nov 03 12:14:25 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb Nov 03 12:14:25 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.448s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:25 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4 Nov 03 12:14:25 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:25 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cd695c88-80ac-43d3-a8d9-219b93f2effb" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-cd695c88-80ac-43d3-a8d9-219b93f2effb" released by "delete_volume" :: held 0.810s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['701242ef-b04e-4c28-a24c-a84eae57269d', 'f15a11ad-fe94-435d-888c-fd5ef0f4be2f', 'e529670e-2771-4aeb-95be-3ef6f5c067a2', '750d393a-f4b3-477e-84df-5e5307d23592'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:26 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:26 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:26 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1.2ff9c45c-d573-4f50-ad27-c2d12d0840f4" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-2ff9c45c-d573-4f50-ad27-c2d12d0840f4" released by "_delete_snapshot" :: held 1.773s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" released by "delete_snapshot" :: held 1.830s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-c53622dc-0236-4234-b4ff-f3d0c6298a66-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-c53622dc-0236-4234-b4ff-f3d0c6298a66-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:26 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-c53622dc-0236-4234-b4ff-f3d0c6298a66" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Created reservations ['d2939c20-fe6b-4676-bb32-1f42893f58bb', 'e5f5df9f-03e3-4807-b8d6-9d3cf6880a00', '944aced8-474c-4d69-bf64-d8d64f4d2bd5', '2eed3818-ce12-4bad-aece-518ed3659dc0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-c53622dc-0236-4234-b4ff-f3d0c6298a66" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c61eb487-1027-4fe7-8b12-e83d5c9b0c1c tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-cd695c88-80ac-43d3-a8d9-219b93f2effb-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f15175-525f-4c71-9dd8-93c2bbc4b816]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Delete snapshot completed successfully. Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-579a096b-3eee-46b1-abcc-c8003d5f7f2f tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-2ff9c45c-d573-4f50-ad27-c2d12d0840f4-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:26 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 Nov 03 12:14:26 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:26 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:26 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66 Nov 03 12:14:26 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Flow 'volume_create_manager' (21b19b19-8129-4b48-be77-7c4a2223d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bb6bb7-5700-427f-b3a6-3a9f2ad51607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bb6bb7-5700-427f-b3a6-3a9f2ad51607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-845114088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec68459d-5860-4cb4-a324-71b9f25de0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6540e2f78dbb4d348374c9ea2aa18c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9009ae52-1ce7-4784-b558-d740bfffd238,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:27Z,use_quota=True,user_id='115715fe689a49c48e61abf301d20651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a7fdec-cf59-42f6-b8ca-6af19335332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a7fdec-cf59-42f6-b8ca-6af19335332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ac0a5f-08d0-446a-9cdb-57b7154b08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ac0a5f-08d0-446a-9cdb-57b7154b08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ec68459d-5860-4cb4-a324-71b9f25de0ca', 'volume_name': 'volume-ec68459d-5860-4cb4-a324-71b9f25de0ca', 'volume_size': 2, 'source_volid': '9009ae52-1ce7-4784-b558-d740bfffd238', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e5a8d9-56b3-47e3-b05e-1cf1135cf86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e5a8d9-56b3-47e3-b05e-1cf1135cf86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e040a11d-4979-4f74-8208-bc02ff6c07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Volume ec68459d-5860-4cb4-a324-71b9f25de0ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ec68459d-5860-4cb4-a324-71b9f25de0ca', 'volume_size': 2, 'source_volid': '9009ae52-1ce7-4784-b558-d740bfffd238', 'source_volstatus': 'available'} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:27 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Cloning volume 9009ae52-1ce7-4784-b558-d740bfffd238 to volume ec68459d-5860-4cb4-a324-71b9f25de0ca Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Creating offline snapshot 49c0f01a-181f-44c6-8ad5-4d96a638404d of volume 9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b515f46-bb20-4e0c-935c-6989c3500415]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:27 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c53622dc-0236-4234-b4ff-f3d0c6298a66" returned: 0 in 0.282s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-c53622dc-0236-4234-b4ff-f3d0c6298a66" released by "delete_volume" :: held 0.758s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['96c5a85e-4b83-4122-94ce-15a8b7117a73', 'ab71ae8d-878f-46d1-8bac-625879052203', 'd6484199-3d85-4e89-a981-f2013188108f', '2c2cabe6-fe25-4a91-9d59-c188f2c611d0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:27 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:27 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:27 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:27 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-fc469f50-0d7a-4bce-81d8-cb972c52f0e9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-fc469f50-0d7a-4bce-81d8-cb972c52f0e9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:27 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:27 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" acquired by "delete_volume" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da1c2f07-fc5e-4767-8931-21d445b74eb6 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-c53622dc-0236-4234-b4ff-f3d0c6298a66-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.569s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[62568533-8fba-4f4b-aa73-f735caacd545]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:27 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d 1G Nov 03 12:14:27 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:27 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 Nov 03 12:14:27 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f5d15-89aa-45bb-aec1-e5528b374dcf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 Nov 03 12:14:28 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9 Nov 03 12:14:28 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d 1G" returned: 0 in 0.533s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9009ae52-1ce7-4784-b558-d740bfffd238 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9009ae52-1ce7-4784-b558-d740bfffd238 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:28 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1 Nov 03 12:14:28 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-fc469f50-0d7a-4bce-81d8-cb972c52f0e9" released by "delete_volume" :: held 0.843s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['de79dc3d-8c4e-4940-9755-dfcb3675a293', '04ed5895-0bac-4686-9934-5c22d309a231', '74b7a4cb-85cf-4505-bab0-3ae4421b1f4b', 'd34a2975-e968-4d25-9d94-9ba918ae2569'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:28 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9009ae52-1ce7-4784-b558-d740bfffd238 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d is being set with open permissions: ugo+rw Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:28 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" returned: 0 in 0.355s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-quobyte-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1" released by "delete_volume" :: held 0.916s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:28 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:28 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-52a91434-90b3-49cd-85e7-6bc57515bc2e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-52a91434-90b3-49cd-85e7-6bc57515bc2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Created reservations ['0c20f3e2-d04e-42f3-8815-82f93b955065', '3973bc11-1ab7-4cba-9082-84d9857c3c81', 'e7d47ddd-df2a-49f3-a2d8-5054e66d2430', '2fa5872d-e810-4d6c-a985-43f6db64ecb9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-52a91434-90b3-49cd-85e7-6bc57515bc2e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-52a91434-90b3-49cd-85e7-6bc57515bc2e" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0c57a-72aa-425e-b725-7952bbda1620]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.438s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e Nov 03 12:14:29 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:29 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:29 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.465s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:29 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info Nov 03 12:14:29 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (3016114c-5e2b-408b-99ec-7e9ead0fad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf113127-f488-49f7-a6e7-a94931164a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c2f2ce0-e95c-4305-bc08-1429832e64dd tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-fc469f50-0d7a-4bce-81d8-cb972c52f0e9-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf113127-f488-49f7-a6e7-a94931164a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656642891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436fb23b-f4cc-45a7-8540-f135abcb13fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:29Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cec52a-5ce3-490f-8587-aa2e7e718a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cec52a-5ce3-490f-8587-aa2e7e718a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c457d838-508e-4e62-86a1-9607b72018dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c457d838-508e-4e62-86a1-9607b72018dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436fb23b-f4cc-45a7-8540-f135abcb13fb', 'volume_name': 'volume-436fb23b-f4cc-45a7-8540-f135abcb13fb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cb10dd-3522-4e20-8957-7e464a2b588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cb10dd-3522-4e20-8957-7e464a2b588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8a71a9-1a7a-4693-8f32-1e2324887325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Volume 436fb23b-f4cc-45a7-8540-f135abcb13fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436fb23b-f4cc-45a7-8540-f135abcb13fb', 'volume_size': 1} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:29 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e" returned: 0 in 0.446s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.349s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Deleted volume successfully. Nov 03 12:14:29 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e Nov 03 12:14:29 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1add1a57-2e5b-45da-bc4b-0edbf38d307b tempest-VolumesSnapshotListTestJSON-867772669 None] Lock "cinder-b6ec7f90-fd4f-44d2-9988-c1120a0f2fb1-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:29 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info" returned: 0 in 0.384s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info is being set with open permissions: ugo+rw Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info Nov 03 12:14:29 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:29 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-52a91434-90b3-49cd-85e7-6bc57515bc2e" returned: 0 in 0.266s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-52a91434-90b3-49cd-85e7-6bc57515bc2e" released by "delete_volume" :: held 0.781s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:29 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.info" returned: 0 in 0.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['e54b0b97-b86e-4e28-abf7-699843307077', '57a13f0e-5793-4a4d-a340-07e0de835ea2', '780fa8ab-6dd0-43f3-bb5c-738f14d7b0fb', 'c7f51a8f-583e-4c86-9cc9-8f5550bea4c5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] snapshot: 49c0f01a-181f-44c6-8ad5-4d96a638404d, volume: ec68459d-5860-4cb4-a324-71b9f25de0ca, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c17a069-4c9c-48c0-bbcd-d2e368ce7664]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:29 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:29 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:30 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:30 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-0d2693c4-356d-45b0-842f-276a3c55446b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-0d2693c4-356d-45b0-842f-276a3c55446b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:30 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.332s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-0d2693c4-356d-45b0-842f-276a3c55446b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8f77214-3fa3-4983-9950-031588921435 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-52a91434-90b3-49cd-85e7-6bc57515bc2e-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-0d2693c4-356d-45b0-842f-276a3c55446b" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:30 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.456s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9009ae52-1ce7-4784-b558-d740bfffd238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff5c24-572a-4365-b3a8-4c4424bc5455]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fbd82b-a7f4-4a10-a706-0d3e990c9885]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:30 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b Nov 03 12:14:30 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:30 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:30 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:30 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:30 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:14:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:30 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b Nov 03 12:14:30 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:30 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca Nov 03 12:14:30 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:31 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0d2693c4-356d-45b0-842f-276a3c55446b" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-0d2693c4-356d-45b0-842f-276a3c55446b" released by "delete_volume" :: held 0.710s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['59731d0e-b0ea-427b-bdad-9f430be6ca43', 'a40c8779-439b-4609-b7a5-53e53c3ecdb8', '6977c51a-564d-4e2e-bd4f-cf453a74ae99', '9f4d914c-453d-49ed-a47f-10c809b9ad55'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:31 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:31 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-a24d6d69-092a-4249-a035-b7e0a301d0c0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-a24d6d69-092a-4249-a035-b7e0a301d0c0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "cinder-quobyte-a24d6d69-092a-4249-a035-b7e0a301d0c0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-a24d6d69-092a-4249-a035-b7e0a301d0c0" acquired by "delete_volume" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:31 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.480s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87c456e6-1018-4c0d-beb6-0cf0b13425a1 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-0d2693c4-356d-45b0-842f-276a3c55446b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07d4dd-244c-47a8-939a-0cd04ce0e999]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:31 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 Nov 03 12:14:31 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:32 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0" returned: 0 in 0.749s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:32 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0 Nov 03 12:14:32 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:33 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a24d6d69-092a-4249-a035-b7e0a301d0c0" returned: 0 in 0.670s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-quobyte-a24d6d69-092a-4249-a035-b7e0a301d0c0" released by "delete_volume" :: held 1.553s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Created reservations ['82470414-1b11-4de5-9ceb-d5197dded85e', 'cae023e7-7c60-4926-9214-ef7f0fd9d451', '8eeb047b-4456-4966-a53d-0a05dd796b0a', '1a2c6970-b2cc-4cd2-9b49-0bd5a032fc51'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:33 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:33 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:34 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Deleted volume successfully. Nov 03 12:14:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-832c51ad-8482-4184-a81c-dd46115966b7 tempest-CreateVolumesFromSourceVolumeTest-58310165 None] Lock "cinder-a24d6d69-092a-4249-a035-b7e0a301d0c0-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:39 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca" returned: 0 in 9.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:14:39 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Converted 1024.00 MB image at 113.02 MB/s Nov 03 12:14:39 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca is being set with open permissions: ugo+rw Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:39 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca Nov 03 12:14:39 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Flow 'volume_create_manager' (953841c3-2ea2-4ab2-80cf-b2c34f8afe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb0264-1e74-48f1-ad24-f1df6974bda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb0264-1e74-48f1-ad24-f1df6974bda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-865692052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255f7bd-7256-45e5-93d0-23daa18dfe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c32a7bacbd24df6b4f6076232552e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:40Z,use_quota=True,user_id='9275b10d7013437480a69994c45e14cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f4bceb-a7bf-48cd-833f-0579a59310c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f4bceb-a7bf-48cd-833f-0579a59310c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8618f854-0b13-4dac-80e3-7de7e6162f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8618f854-0b13-4dac-80e3-7de7e6162f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8255f7bd-7256-45e5-93d0-23daa18dfe1f', 'volume_name': 'volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971058ea-8ef5-426d-b2d4-98a48d6b7694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971058ea-8ef5-426d-b2d4-98a48d6b7694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604bc75e-4978-4e6e-b2fd-491009337c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Volume 8255f7bd-7256-45e5-93d0-23daa18dfe1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f', 'volume_size': 1} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:40 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" released by "_copy_volume_from_snapshot" :: held 10.259s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-quobyte-49c0f01a-181f-44c6-8ad5-4d96a638404d" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-49c0f01a-181f-44c6-8ad5-4d96a638404d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Deleting offline snapshot 49c0f01a-181f-44c6-8ad5-4d96a638404d of volume 9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] snapshot_file for this snap is: volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b066c0ec-a286-4cd5-a2f8-0f0856b83849]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:40 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:40 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:40 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.411s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9009ae52-1ce7-4784-b558-d740bfffd238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa217d86-2213-4339-8834-bc3a4b0f0f4f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:40 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:40 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:41 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.546s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:41 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:41 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:41 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.491s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:41 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d Nov 03 12:14:41 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:41 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238.49c0f01a-181f-44c6-8ad5-4d96a638404d" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-49c0f01a-181f-44c6-8ad5-4d96a638404d" released by "_delete_snapshot" :: held 1.834s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.918s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.642s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656642891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436fb23b-f4cc-45a7-8540-f135abcb13fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:29Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Creating volume 436fb23b-f4cc-45a7-8540-f135abcb13fb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:42 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb 1073741824 Nov 03 12:14:42 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e040a11d-4979-4f74-8208-bc02ff6c07d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec68459d-5860-4cb4-a324-71b9f25de0ca', 'volume_size': 2, 'source_volid': '9009ae52-1ce7-4784-b558-d740bfffd238', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4899e2bc-f209-4636-83aa-598e46ce978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Volume volume-ec68459d-5860-4cb4-a324-71b9f25de0ca (ec68459d-5860-4cb4-a324-71b9f25de0ca): created successfully Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4899e2bc-f209-4636-83aa-598e46ce978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Flow 'volume_create_manager' (21b19b19-8129-4b48-be77-7c4a2223d072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9aabeaa9-65ef-475d-b731-ee939acf0c05 tempest-VolumesCloneTest-16166726 None] Created volume successfully. Nov 03 12:14:42 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb 1073741824" returned: 0 in 0.537s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:42 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb Nov 03 12:14:42 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-ec68459d-5860-4cb4-a324-71b9f25de0ca-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "cinder-ec68459d-5860-4cb4-a324-71b9f25de0ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b1d40-50db-49d9-8601-3de33e239dba]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:42 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.944s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-865692052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255f7bd-7256-45e5-93d0-23daa18dfe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c32a7bacbd24df6b4f6076232552e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:40Z,use_quota=True,user_id='9275b10d7013437480a69994c45e14cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Creating volume 8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8a71a9-1a7a-4693-8f32-1e2324887325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436fb23b-f4cc-45a7-8540-f135abcb13fb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:43 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f 1073741824 Nov 03 12:14:43 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df8098-963f-460e-b5fd-bb2fa60e703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Volume volume-436fb23b-f4cc-45a7-8540-f135abcb13fb (436fb23b-f4cc-45a7-8540-f135abcb13fb): created successfully Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df8098-963f-460e-b5fd-bb2fa60e703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (3016114c-5e2b-408b-99ec-7e9ead0fad0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f1e8b299-e1ae-4bfb-874c-d5a896435e88 tempest-AttachVolumeNegativeTest-67719601 None] Created volume successfully. Nov 03 12:14:43 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca Nov 03 12:14:43 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:43 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca" returned: 0 in 0.549s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:43 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca Nov 03 12:14:43 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:43 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f 1073741824" returned: 0 in 0.621s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:43 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:14:43 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:43 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ec68459d-5860-4cb4-a324-71b9f25de0ca" returned: 0 in 0.311s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-ec68459d-5860-4cb4-a324-71b9f25de0ca" released by "delete_volume" :: held 0.946s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Created reservations ['bff46d3a-407c-472e-8b86-e14d54c8f6f2', '78a7e014-b7e4-4784-9e50-2491f3c4eac8', 'f6b431fe-1ce3-455e-921b-e466ed64d443', 'c07d70c6-76fe-4b6d-9b34-611aa5fbfe63'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:44 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.345s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604bc75e-4978-4e6e-b2fd-491009337c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb7d238-323d-4972-86b6-8de6374b7450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Volume volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f (8255f7bd-7256-45e5-93d0-23daa18dfe1f): created successfully Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb7d238-323d-4972-86b6-8de6374b7450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Flow 'volume_create_manager' (953841c3-2ea2-4ab2-80cf-b2c34f8afe75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:44 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:44 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-375e1a7b-ffdf-4ccd-9e8e-5d6781341162 tempest-VolumeDependencyTests-848556920 None] Created volume successfully. Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Creating offline snapshot 891b7eff-9536-460d-a6e9-3d8ce89c141f of volume 8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:14:44 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.531s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[718fc746-3182-48c6-82b8-9f0f75c19b94]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Deleted volume successfully. Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-329241da-9131-4fde-8c18-208dce973958 tempest-VolumesCloneTest-16166726 None] Lock "cinder-ec68459d-5860-4cb4-a324-71b9f25de0ca-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:44 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:14:44 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bc68ea42-bee7-4c44-a5f0-c8b27d6ccbb2 req-1d7821dd-8d1e-420f-8b46-54874275f6fd tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:45 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:45 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f 1G Nov 03 12:14:45 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-9009ae52-1ce7-4784-b558-d740bfffd238-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "cinder-9009ae52-1ce7-4784-b558-d740bfffd238-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Acquiring lock "cinder-quobyte-9009ae52-1ce7-4784-b558-d740bfffd238" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-9009ae52-1ce7-4784-b558-d740bfffd238" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcec4fe-3f46-42c6-a3c0-8c3cc02030b1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:45 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:45 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:45 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f 1G" returned: 0 in 0.537s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:45 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:14:45 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:45 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:45 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238 Nov 03 12:14:45 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:45 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:45 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f is being set with open permissions: ugo+rw Nov 03 12:14:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:45 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:14:45 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:46 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9009ae52-1ce7-4784-b558-d740bfffd238" returned: 0 in 0.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "cinder-quobyte-9009ae52-1ce7-4784-b558-d740bfffd238" released by "delete_volume" :: held 0.788s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:46 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Created reservations ['c70bc5b1-26db-4ab5-b4a3-4e04b95f4736', '3ff93542-0bb1-442e-95dd-d9200e65ef1e', '8982e17a-5a24-439d-943b-03256e3be470', '3485d552-5a2a-40f8-b039-d197eb6ebbfa'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:46 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info Nov 03 12:14:46 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:46 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:14:46 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:46 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info" returned: 0 in 0.390s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info is being set with open permissions: ugo+rw Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:46 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:14:46 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info Nov 03 12:14:46 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Deleted volume successfully. Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ca099ad0-b6f1-4bde-b71b-da77d528d5c4 tempest-VolumesCloneTest-16166726 None] Lock "cinder-9009ae52-1ce7-4784-b558-d740bfffd238-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:46 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.info" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bc68ea42-bee7-4c44-a5f0-c8b27d6ccbb2 req-1d7821dd-8d1e-420f-8b46-54874275f6fd tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bc68ea42-bee7-4c44-a5f0-c8b27d6ccbb2 req-1d7821dd-8d1e-420f-8b46-54874275f6fd tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-798d3467-a471-4199-aae1-839027abfa5a tempest-VolumeDependencyTests-848556920 None] Create snapshot completed successfully Nov 03 12:14:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-bc68ea42-bee7-4c44-a5f0-c8b27d6ccbb2 req-1d7821dd-8d1e-420f-8b46-54874275f6fd tempest-AttachVolumeNegativeTest-67719601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-436fb23b-f4cc-45a7-8540-f135abcb13fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22266689-e290-4ea4-9924-16c932926a06', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:14:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-bc68ea42-bee7-4c44-a5f0-c8b27d6ccbb2 req-1d7821dd-8d1e-420f-8b46-54874275f6fd tempest-AttachVolumeNegativeTest-67719601 None] attachment_update completed successfully. Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Flow 'volume_create_manager' (93a10bfa-d5e8-4fdb-ae09-58f686214368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c755b4-dad1-4c37-9447-493b91978ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c755b4-dad1-4c37-9447-493b91978ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1187537763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a6eb83-3809-4bfb-858b-c3a4744f3cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c32a7bacbd24df6b4f6076232552e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=891b7eff-9536-460d-a6e9-3d8ce89c141f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:48Z,use_quota=True,user_id='9275b10d7013437480a69994c45e14cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae88ab6-ecb2-4aae-ae90-4344f7a9eb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae88ab6-ecb2-4aae-ae90-4344f7a9eb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928825e-44e8-4c07-bbdc-78859fd1b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928825e-44e8-4c07-bbdc-78859fd1b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8a6eb83-3809-4bfb-858b-c3a4744f3cd1', 'volume_name': 'volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1', 'volume_size': 1, 'snapshot_id': '891b7eff-9536-460d-a6e9-3d8ce89c141f'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b35a33-bd28-4458-868b-d90983d91b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b35a33-bd28-4458-868b-d90983d91b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6e80a6-c372-477a-aed1-0c582e1d2a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Volume b8a6eb83-3809-4bfb-858b-c3a4744f3cd1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1', 'volume_size': 1, 'snapshot_id': '891b7eff-9536-460d-a6e9-3d8ce89c141f'} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Creating volume b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 from snapshot 891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] snapshot: 891b7eff-9536-460d-a6e9-3d8ce89c141f, volume: b8a6eb83-3809-4bfb-858b-c3a4744f3cd1, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4c89f-5444-4134-af57-8f7c416d8ab0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:48 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:14:48 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:49 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.587s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de1cb3e-21dd-47b7-a2ff-477e27a13732]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:49 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:14:49 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:49 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.515s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:14:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:49 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 Nov 03 12:14:49 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-a40c94b8-cf4d-4d8a-8ea7-244f21039813 req-ad4506d4-6fd2-46e1-97ad-fbd41515156d tempest-AttachVolumeNegativeTest-67719601 None] Terminate volume connection completed successfully. Nov 03 12:14:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-a40c94b8-cf4d-4d8a-8ea7-244f21039813 req-ad4506d4-6fd2-46e1-97ad-fbd41515156d tempest-AttachVolumeNegativeTest-67719601 None] Deleting attachment 22266689-e290-4ea4-9924-16c932926a06. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:14:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:14:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (764dc611-fe8b-45ee-a424-2bd1b1e15f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5d89e8-34dd-4437-88f8-d9d30329e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5d89e8-34dd-4437-88f8-d9d30329e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677105032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9c2b62-a8cf-4751-be26-41f857f1a3c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:53Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da1891a-a84a-4c27-91c7-35cb1d804650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da1891a-a84a-4c27-91c7-35cb1d804650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8666be7a-0cd7-446d-85c2-545d079db3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8666be7a-0cd7-446d-85c2-545d079db3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9c2b62-a8cf-4751-be26-41f857f1a3c3', 'volume_name': 'volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdff711c-b96b-449d-9fde-5dc2795d3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdff711c-b96b-449d-9fde-5dc2795d3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c8579e-bbc9-4eda-9223-6b22ebb072d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Volume df9c2b62-a8cf-4751-be26-41f857f1a3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3', 'volume_size': 1} Nov 03 12:14:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:58 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" returned: 0 in 9.012s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:58 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:14:58 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Converted 1024.00 MB image at 113.62 MB/s Nov 03 12:14:58 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 is being set with open permissions: ugo+rw Nov 03 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:58 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 Nov 03 12:14:58 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:59 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" released by "_copy_volume_from_snapshot" :: held 10.549s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=187,cinder:SELECT=151,cinder:DELETE=23,cinder:INSERT=43 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=163,cinder:INSERT=58,cinder:UPDATE=217,cinder:DELETE=10 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" released by "_create_volume_from_snapshot" :: held 10.665s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.690s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.212s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677105032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9c2b62-a8cf-4751-be26-41f857f1a3c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:14:53Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Creating volume df9c2b62-a8cf-4751-be26-41f857f1a3c3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:14:59 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:59 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 1073741824 Nov 03 12:14:59 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6e80a6-c372-477a-aed1-0c582e1d2a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1', 'volume_size': 1, 'snapshot_id': '891b7eff-9536-460d-a6e9-3d8ce89c141f'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fddde7-3a3f-4c69-836a-a8de61b09728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:14:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Volume volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 (b8a6eb83-3809-4bfb-858b-c3a4744f3cd1): created successfully Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fddde7-3a3f-4c69-836a-a8de61b09728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Flow 'volume_create_manager' (93a10bfa-d5e8-4fdb-ae09-58f686214368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:14:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8ef7a282-a672-401a-8c6d-272c3663fb94 tempest-VolumeDependencyTests-848556920 None] Created volume successfully. Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-891b7eff-9536-460d-a6e9-3d8ce89c141f-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-891b7eff-9536-460d-a6e9-3d8ce89c141f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Deleting offline snapshot 891b7eff-9536-460d-a6e9-3d8ce89c141f of volume 8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] snapshot_file for this snap is: volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb57437-463e-42ec-bd0f-01fe2e2a950b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:14:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:14:59 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:14:59 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:00 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 1073741824" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:00 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 Nov 03 12:15:00 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:00 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9647773-62da-42aa-956d-a963cb4ffbb7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:00 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3" returned: 0 in 0.442s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:00 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:15:00 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c8579e-bbc9-4eda-9223-6b22ebb072d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6ab103-8857-4a55-ac95-a9ba93b5d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Volume volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 (df9c2b62-a8cf-4751-be26-41f857f1a3c3): created successfully Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6ab103-8857-4a55-ac95-a9ba93b5d73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (764dc611-fe8b-45ee-a424-2bd1b1e15f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d257080e-9465-4728-b169-c43ac7da4d43 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:01 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:01 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:15:01 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:01 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:01 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f Nov 03 12:15:01 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:01 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f.891b7eff-9536-460d-a6e9-3d8ce89c141f" returned: 0 in 0.380s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (dcf912e6-8f68-4367-9334-95a470009d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c152a4-9414-45d9-be07-624cee9d01e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c152a4-9414-45d9-be07-624cee9d01e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-849375281',display_name='tempest-VolumesGetTest-Volume-2065541863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fdb8f5-8a17-4cc0-b240-3d753bf6f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:02Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0795e5c8-4a2b-4519-9530-00e700062a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0795e5c8-4a2b-4519-9530-00e700062a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cde8ae1-9890-44f0-b0c3-a7b55bfb9b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cde8ae1-9890-44f0-b0c3-a7b55bfb9b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fdb8f5-8a17-4cc0-b240-3d753bf6f426', 'volume_name': 'volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2758aa47-34a3-445c-b581-36f968c01ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2758aa47-34a3-445c-b581-36f968c01ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c100de-6a23-4726-8b44-c0e4530c1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Volume 27fdb8f5-8a17-4cc0-b240-3d753bf6f426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426', 'volume_size': 1} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-849375281',display_name='tempest-VolumesGetTest-Volume-2065541863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fdb8f5-8a17-4cc0-b240-3d753bf6f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:02Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Creating volume 27fdb8f5-8a17-4cc0-b240-3d753bf6f426 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:02 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:02 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 1073741824 Nov 03 12:15:02 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-891b7eff-9536-460d-a6e9-3d8ce89c141f" released by "_delete_snapshot" :: held 2.279s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" released by "delete_snapshot" :: held 2.316s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Created reservations ['bdd26ad6-14fb-4747-98e8-e6d202d6cf14', 'b2e60ba9-7f26-442a-b596-156d9b255423', '07f9c62d-7360-4ac4-874b-c4dbbc609500', 'd6a4b6da-925a-4fe3-90aa-212dc92bfd87'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Delete snapshot completed successfully. Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-19d77eac-3fa9-49f7-8aee-13a401b3e992 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-891b7eff-9536-460d-a6e9-3d8ce89c141f-delete_snapshot" released by "delete_snapshot" :: held 2.535s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:02 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 1073741824" returned: 0 in 0.588s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:02 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 Nov 03 12:15:02 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:02 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c100de-6a23-4726-8b44-c0e4530c1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3218c6-64e5-4f7f-b143-2418db5f98c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Volume volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 (27fdb8f5-8a17-4cc0-b240-3d753bf6f426): created successfully Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3218c6-64e5-4f7f-b143-2418db5f98c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (dcf912e6-8f68-4367-9334-95a470009d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-27f055a2-a2f9-4067-a6ae-6d2620aba688 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-8255f7bd-7256-45e5-93d0-23daa18dfe1f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-8255f7bd-7256-45e5-93d0-23daa18dfe1f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f5750-7aa9-451e-a529-098eaed6774d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:03 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:15:03 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:03 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.479s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:03 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f Nov 03 12:15:03 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:03 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8255f7bd-7256-45e5-93d0-23daa18dfe1f" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-8255f7bd-7256-45e5-93d0-23daa18dfe1f" released by "delete_volume" :: held 0.850s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Created reservations ['eb5a829b-0dce-4d6c-ab16-d3c483fc8115', '264864e0-1213-4865-80eb-aa5549ef501c', '715f7985-a674-4ff9-8e40-d9fac2fc346e', '62be057b-242c-4472-a95d-05b681f52812'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:04 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-27fdb8f5-8a17-4cc0-b240-3d753bf6f426-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:04 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "cinder-27fdb8f5-8a17-4cc0-b240-3d753bf6f426-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f84776-51e0-4bb0-98f0-64f4e83e1b8d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e89ba1-2208-4db7-b462-ad0554da4ad1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:04 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 Nov 03 12:15:04 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:04 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 Nov 03 12:15:04 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:04 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.495s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Deleted volume successfully. Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5c70b559-b271-4ebe-b2ce-5ac0ccfbd9b2 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-8255f7bd-7256-45e5-93d0-23daa18dfe1f-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:04 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" returned: 0 in 0.485s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:04 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" returned: 0 in 0.509s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:04 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1 Nov 03 12:15:04 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:05 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426 Nov 03 12:15:05 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:05 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" returned: 0 in 0.278s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-27fdb8f5-8a17-4cc0-b240-3d753bf6f426" released by "delete_volume" :: held 0.875s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:05 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Created reservations ['bdcec5ea-9df8-4d25-9db6-8abccc587b0e', '085e8622-98a3-431c-a62e-c5ca4c5e3cbb', '07e3a763-60ec-46a3-b1e2-d67dea4ab276', '98860275-67a1-4714-8760-dbf4dd249e65'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" returned: 0 in 0.452s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-quobyte-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1" released by "delete_volume" :: held 1.030s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Created reservations ['5b2e7329-e81d-41b7-a98b-3cda867d3499', 'c361aa57-4ec9-460d-a335-3b58b3da4569', '1bcbb8d1-f3eb-4239-8708-055a1d0a837c', '0bc13a68-adc7-4eed-a083-1c0b38396e26'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:05 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:05 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:05 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:05 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:05 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-027e6287-cf4a-4103-942e-e10b407cc2dc tempest-VolumesGetTest-691376272 None] Lock "cinder-27fdb8f5-8a17-4cc0-b240-3d753bf6f426-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:06 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Deleted volume successfully. Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-faeafb4f-6c3f-413a-8807-b93a1cce3dc5 tempest-VolumeDependencyTests-848556920 None] Lock "cinder-b8a6eb83-3809-4bfb-858b-c3a4744f3cd1-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-df9c2b62-a8cf-4751-be26-41f857f1a3c3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "cinder-df9c2b62-a8cf-4751-be26-41f857f1a3c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-df9c2b62-a8cf-4751-be26-41f857f1a3c3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-df9c2b62-a8cf-4751-be26-41f857f1a3c3" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eff786-be8c-40c6-a1dd-d67d6fb97a5e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:06 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 Nov 03 12:15:06 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:07 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3" returned: 0 in 0.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:07 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3 Nov 03 12:15:07 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:07 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-df9c2b62-a8cf-4751-be26-41f857f1a3c3" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-df9c2b62-a8cf-4751-be26-41f857f1a3c3" released by "delete_volume" :: held 0.940s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Created reservations ['7b7973fe-c3e6-4cf2-809b-3a826e593c80', '601b8f87-b857-4da9-9ec3-69772a0bae50', 'ae779dbb-fe6b-4cdf-a21d-b185ad214133', '49a25f32-07b0-412c-b5f9-22ba478ae102'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:07 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:07 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:08 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7bf43107-c5e5-4010-bb44-c80d20b49710 tempest-VolumesGetTest-691376272 None] Lock "cinder-df9c2b62-a8cf-4751-be26-41f857f1a3c3-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (e60cd4d3-27d6-47bc-9134-a0445f81e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8516d604-ec8c-4f13-9500-168abb45185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8516d604-ec8c-4f13-9500-168abb45185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1007811575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875aeebe-4704-4b56-a0e4-921d9b89a229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:10Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc65d7d7-0e4c-4a50-9923-3a5b6dffc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc65d7d7-0e4c-4a50-9923-3a5b6dffc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e96d05-d38c-486c-9600-9cc9317a8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e96d05-d38c-486c-9600-9cc9317a8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875aeebe-4704-4b56-a0e4-921d9b89a229', 'volume_name': 'volume-875aeebe-4704-4b56-a0e4-921d9b89a229', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d595af0-ae44-4fac-a4af-2dda11ec63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d595af0-ae44-4fac-a4af-2dda11ec63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19723e8-15ea-4314-8dd5-62235c88c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Volume 875aeebe-4704-4b56-a0e4-921d9b89a229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875aeebe-4704-4b56-a0e4-921d9b89a229', 'volume_size': 1} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1007811575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875aeebe-4704-4b56-a0e4-921d9b89a229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:10Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Creating volume 875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:09 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 1073741824 Nov 03 12:15:09 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:10 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 1073741824" returned: 0 in 0.653s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:10 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:10 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:10 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19723e8-15ea-4314-8dd5-62235c88c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875aeebe-4704-4b56-a0e4-921d9b89a229', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c23106-ec71-41e9-887c-6933d6a55a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Volume volume-875aeebe-4704-4b56-a0e4-921d9b89a229 (875aeebe-4704-4b56-a0e4-921d9b89a229): created successfully Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c23106-ec71-41e9-887c-6933d6a55a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (e60cd4d3-27d6-47bc-9134-a0445f81e111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fda20a1a-5fd5-4d89-9e8b-3d6d3e7a685c tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (d246f94b-368c-4771-8cdd-b563be299471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa75e7b-2749-46c5-9ea3-afe92b2cb33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa75e7b-2749-46c5-9ea3-afe92b2cb33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1127642420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619629b9-f84e-4332-981d-acd06a83336c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=875aeebe-4704-4b56-a0e4-921d9b89a229,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:13Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dec3b6-25e9-40a8-9339-075a4a011d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dec3b6-25e9-40a8-9339-075a4a011d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a923c423-1040-4ba3-a230-dae79977e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a923c423-1040-4ba3-a230-dae79977e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '619629b9-f84e-4332-981d-acd06a83336c', 'volume_name': 'volume-619629b9-f84e-4332-981d-acd06a83336c', 'volume_size': 1, 'source_volid': '875aeebe-4704-4b56-a0e4-921d9b89a229', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d24d66-ab27-4473-ae92-3d92c02ff331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d24d66-ab27-4473-ae92-3d92c02ff331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9e80e-7e94-4b00-ac75-5e7bcbd7f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Volume 619629b9-f84e-4332-981d-acd06a83336c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-619629b9-f84e-4332-981d-acd06a83336c', 'volume_size': 1, 'source_volid': '875aeebe-4704-4b56-a0e4-921d9b89a229', 'source_volstatus': 'available'} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:13 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Cloning volume 875aeebe-4704-4b56-a0e4-921d9b89a229 to volume 619629b9-f84e-4332-981d-acd06a83336c Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Creating offline snapshot b10f3ada-4c32-4548-a560-d026a52f1bf0 of volume 875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecd6156-2938-49b4-b1a6-1cf18f8a2c20]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:13 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:13 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:14 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.685s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:14 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 1G Nov 03 12:15:14 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:14 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 1G" returned: 0 in 0.677s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875aeebe-4704-4b56-a0e4-921d9b89a229 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:14 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875aeebe-4704-4b56-a0e4-921d9b89a229 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:14 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:15 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875aeebe-4704-4b56-a0e4-921d9b89a229 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.667s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 is being set with open permissions: ugo+rw Nov 03 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:15 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:15 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:15 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.570s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:16 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info Nov 03 12:15:16 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:16 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info" returned: 0 in 0.661s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info is being set with open permissions: ugo+rw Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:16 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info Nov 03 12:15:16 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Flow 'volume_create_manager' (55de6f68-deb9-45ca-9648-68a5a92c21a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dcb81d-fcb5-40a8-97e1-716fa59db7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dcb81d-fcb5-40a8-97e1-716fa59db7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c5570e-99d0-48e1-9ebb-5cbc9da44c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43c595d356242259340aee456fab6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:17Z,use_quota=True,user_id='9aa39ee12c37416fa38f03792bcc865f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf84bdd-e76c-4486-9ee9-bdf13bd1f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf84bdd-e76c-4486-9ee9-bdf13bd1f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6346c3d4-8130-44c1-91d6-a339bfd490a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:15:17 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.info" returned: 0 in 0.559s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] snapshot: b10f3ada-4c32-4548-a560-d026a52f1bf0, volume: 619629b9-f84e-4332-981d-acd06a83336c, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde35b97-6b2b-4d0d-8044-fe1241438e5f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:17 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:17 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6346c3d4-8130-44c1-91d6-a339bfd490a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59c5570e-99d0-48e1-9ebb-5cbc9da44c87', 'volume_name': 'volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87', 'volume_size': 1, 'image_id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6849333d7076df5ef59f2fbabaddb28', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f43c595d356242259340aee456fab6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c20665a95868cce4ffba016c4abd37f128ca8c44547ac4ce639317539a5fee3ade25c8612643bc1323bb61c52c795b533f23c5d2bfdce691e7734e8253b7a2d', 'id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'created_at': datetime.datetime(2026, 11, 3, 11, 15, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 15, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938c29f1-52f0-4d54-bc6e-728122e6b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938c29f1-52f0-4d54-bc6e-728122e6b676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11962714-dc86-44da-b2c5-5063491c20a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87', 'volume_size': 1, 'image_id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6849333d7076df5ef59f2fbabaddb28', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f43c595d356242259340aee456fab6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c20665a95868cce4ffba016c4abd37f128ca8c44547ac4ce639317539a5fee3ade25c8612643bc1323bb61c52c795b533f23c5d2bfdce691e7734e8253b7a2d', 'id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'created_at': datetime.datetime(2026, 11, 3, 11, 15, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 15, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648/file', 'properties': {}}, 'image_service': } Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Trying to clone 59c5570e-99d0-48e1-9ebb-5cbc9da44c87 from image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:15:17 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Image download 0.00 MB at 0.00 MB/s Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ee40f-605f-46a9-98e5-c6d411569872]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:18 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.695s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875aeebe-4704-4b56-a0e4-921d9b89a229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ff85c-30b5-4c7a-901f-716a0b22917e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:18 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:18 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:18 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:18 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:18 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:18 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.712s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:18 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c Nov 03 12:15:18 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:19 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:19 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:19 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:15:19 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Temporary image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 is fetched for user 9aa39ee12c37416fa38f03792bcc865f. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:15:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0658710-4619-4bcf-be23-e9aae0b4e4ec]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:20 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:20 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:20 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 0 in 1.049s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:21 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:21 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:22 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 1 in 1.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:15:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:24 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:24 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:25 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 1.511s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:25 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:15:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:15:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Flow 'volume_create_manager' (b359a371-67dc-43c1-8e70-53447920170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28baf4c-08fb-4c18-a63a-768a4d604521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28baf4c-08fb-4c18-a63a-768a4d604521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1397036140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a988f908-c853-403e-a061-67bb44e6ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226eaab05fd4e8a8afe0add127412d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:29Z,use_quota=True,user_id='8f7f83aba8fd4f6d948d50c942bb6c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dfec1-d11f-4e0d-b6e6-a857c5105da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dfec1-d11f-4e0d-b6e6-a857c5105da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e0c6ee-224a-480a-88bf-5e159fc068b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e0c6ee-224a-480a-88bf-5e159fc068b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a988f908-c853-403e-a061-67bb44e6ad93', 'volume_name': 'volume-a988f908-c853-403e-a061-67bb44e6ad93', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e16f4b-46c4-41bc-a8b8-d13bdcc1b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e16f4b-46c4-41bc-a8b8-d13bdcc1b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b96f1-aed9-44e4-bcb5-d6e5d136e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Volume a988f908-c853-403e-a061-67bb44e6ad93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a988f908-c853-403e-a061-67bb44e6ad93', 'volume_size': 1} Nov 03 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:30 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c" returned: 0 in 11.581s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229, size 1024.00 MB, duration 11.58 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:15:30 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Converted 1024.00 MB image at 88.41 MB/s Nov 03 12:15:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c is being set with open permissions: ugo+rw Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:30 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c Nov 03 12:15:30 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:30 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" released by "_copy_volume_from_snapshot" :: held 13.404s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-b10f3ada-4c32-4548-a560-d026a52f1bf0" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-b10f3ada-4c32-4548-a560-d026a52f1bf0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Deleting offline snapshot b10f3ada-4c32-4548-a560-d026a52f1bf0 of volume 875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] snapshot_file for this snap is: volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee32608-49b8-430e-bca5-a81bb9ff31ab]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:30 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:30 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:31 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.364s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875aeebe-4704-4b56-a0e4-921d9b89a229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94b32b7-7ee8-4f31-862d-d85b1009f7ea]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:31 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:31 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:31 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.555s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:31 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:31 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:32 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:32 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0 Nov 03 12:15:32 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:32 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229.b10f3ada-4c32-4548-a560-d026a52f1bf0" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-b10f3ada-4c32-4548-a560-d026a52f1bf0" released by "_delete_snapshot" :: held 1.623s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.303s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.280s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c5570e-99d0-48e1-9ebb-5cbc9da44c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43c595d356242259340aee456fab6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:17Z,use_quota=True,user_id='9aa39ee12c37416fa38f03792bcc865f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Creating volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:32 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1073741824 Nov 03 12:15:32 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9e80e-7e94-4b00-ac75-5e7bcbd7f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619629b9-f84e-4332-981d-acd06a83336c', 'volume_size': 1, 'source_volid': '875aeebe-4704-4b56-a0e4-921d9b89a229', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6d85da-3f47-422f-8f9f-bd423910509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Volume volume-619629b9-f84e-4332-981d-acd06a83336c (619629b9-f84e-4332-981d-acd06a83336c): created successfully Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6d85da-3f47-422f-8f9f-bd423910509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (d246f94b-368c-4771-8cdd-b563be299471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e6f7be0-14ea-420e-b172-a777de918527 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:32 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1073741824" returned: 0 in 0.451s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:32 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 Nov 03 12:15:32 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:33 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.843s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1397036140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a988f908-c853-403e-a061-67bb44e6ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226eaab05fd4e8a8afe0add127412d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:29Z,use_quota=True,user_id='8f7f83aba8fd4f6d948d50c942bb6c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Creating volume a988f908-c853-403e-a061-67bb44e6ad93 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:33 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:33 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 1073741824 Nov 03 12:15:33 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Attempting download of 61ffb0f8-db5b-47c4-9da4-07dc0767d648 ((None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}])) to volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c64b8d-acd9-4bb5-ac52-3256ee2d24e8]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:33 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg Nov 03 12:15:33 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:33 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg" returned: 0 in 0.518s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:34 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg Nov 03 12:15:34 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:34 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 1073741824" returned: 0 in 0.818s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:34 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 Nov 03 12:15:34 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:34 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b96f1-aed9-44e4-bcb5-d6e5d136e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a988f908-c853-403e-a061-67bb44e6ad93', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d86ea-c226-4c69-ae0b-3f9d07291af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Volume volume-a988f908-c853-403e-a061-67bb44e6ad93 (a988f908-c853-403e-a061-67bb44e6ad93): created successfully Nov 03 12:15:34 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d86ea-c226-4c69-ae0b-3f9d07291af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Flow 'volume_create_manager' (b359a371-67dc-43c1-8e70-53447920170b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg" returned: 1 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ffb0f8-db5b-47c4-9da4-07dc0767d648_32eoh0dg' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[82151838-dbe8-4aa0-9f8f-0f389b96b8af]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-32fdce9a-e752-4f4b-ae3b-86705c4b0fdf tempest-TestMinimumBasicScenario-1275035272 None] Created volume successfully. Nov 03 12:15:34 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:34 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:35 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (b53d4277-db25-4f20-9499-427df6a5dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300ecc33-8b80-4349-be75-d0100755e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300ecc33-8b80-4349-be75-d0100755e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-425493251',display_name='tempest-VolumesGetTest-Volume-1731368511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:35Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4ea49e-af94-41e8-b20d-15c926331a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4ea49e-af94-41e8-b20d-15c926331a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc3a77-574a-43f9-a930-4fbeab42b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc3a77-574a-43f9-a930-4fbeab42b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a', 'volume_name': 'volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312c630c-fb73-4848-8938-8302db7b39cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312c630c-fb73-4848-8938-8302db7b39cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc14e89-686a-46e8-bc5e-97aa25e87713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Volume 1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a', 'volume_size': 1} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-425493251',display_name='tempest-VolumesGetTest-Volume-1731368511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:35Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Creating volume 1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:35 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a 1073741824 Nov 03 12:15:35 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:35 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD Nov 03 12:15:35 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:35 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] 61ffb0f8-db5b-47c4-9da4-07dc0767d648 was raw, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:35 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 Nov 03 12:15:35 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:35 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a 1073741824" returned: 0 in 0.635s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:35 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a Nov 03 12:15:35 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:36 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" returned: 0 in 0.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc14e89-686a-46e8-bc5e-97aa25e87713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836de87e-7018-4769-ab3d-b76d37e0f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Volume volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a (1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a): created successfully Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836de87e-7018-4769-ab3d-b76d37e0f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (b53d4277-db25-4f20-9499-427df6a5dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6f525a15-3e66-4ee5-a373-e60e03bace81 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:36 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" returned: 0 in 0.869s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61ffb0f8-db5b-47c4-9da4-07dc0767d648_kdf6noikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:15:36 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:36 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1G Nov 03 12:15:36 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:36 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 1G" returned: 0 in 0.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Downloaded image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 ((None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}])) to volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Temporary image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 for user 9aa39ee12c37416fa38f03792bcc865f is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Marking volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Copying metadata from image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 to 59c5570e-99d0-48e1-9ebb-5cbc9da44c87. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Creating volume glance metadata for volume 59c5570e-99d0-48e1-9ebb-5cbc9da44c87 backed by image 61ffb0f8-db5b-47c4-9da4-07dc0767d648 with: {'image_id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e6849333d7076df5ef59f2fbabaddb28', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11962714-dc86-44da-b2c5-5063491c20a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87', 'volume_size': 1, 'image_id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6849333d7076df5ef59f2fbabaddb28', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f43c595d356242259340aee456fab6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c20665a95868cce4ffba016c4abd37f128ca8c44547ac4ce639317539a5fee3ade25c8612643bc1323bb61c52c795b533f23c5d2bfdce691e7734e8253b7a2d', 'id': '61ffb0f8-db5b-47c4-9da4-07dc0767d648', 'created_at': datetime.datetime(2026, 11, 3, 11, 15, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 15, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ffb0f8-db5b-47c4-9da4-07dc0767d648/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b691821c-8a2d-4cf4-82e0-22af630783e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Volume volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 (59c5570e-99d0-48e1-9ebb-5cbc9da44c87): created successfully Nov 03 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b691821c-8a2d-4cf4-82e0-22af630783e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Flow 'volume_create_manager' (55de6f68-deb9-45ca-9648-68a5a92c21a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-04ee10bc-266e-4f57-acd6-9247c6ace86a tempest-VolumeImageDependencyTests-1624242710 None] Created volume successfully. Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-a078100c-b86e-4095-8e48-2c1b4ab91621 req-7f97433d-7e58-440a-ba53-b53f3593cf25 tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-a078100c-b86e-4095-8e48-2c1b4ab91621 req-7f97433d-7e58-440a-ba53-b53f3593cf25 tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-a078100c-b86e-4095-8e48-2c1b4ab91621 req-7f97433d-7e58-440a-ba53-b53f3593cf25 tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-a078100c-b86e-4095-8e48-2c1b4ab91621 req-7f97433d-7e58-440a-ba53-b53f3593cf25 tempest-TestMinimumBasicScenario-1275035272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-a988f908-c853-403e-a061-67bb44e6ad93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b08d353c-f299-44f7-ace0-f1182200bed1', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:15:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-a078100c-b86e-4095-8e48-2c1b4ab91621 req-7f97433d-7e58-440a-ba53-b53f3593cf25 tempest-TestMinimumBasicScenario-1275035272 None] attachment_update completed successfully. Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Acquiring lock "cinder-59c5570e-99d0-48e1-9ebb-5cbc9da44c87-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "cinder-59c5570e-99d0-48e1-9ebb-5cbc9da44c87-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Acquiring lock "cinder-quobyte-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "cinder-quobyte-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" acquired by "delete_volume" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cbee27-10d2-4920-ab3a-52555b6b050c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "cinder-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f285e44-b216-4cff-9039-29cc5a4a08a9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:37 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 Nov 03 12:15:37 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:37 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a Nov 03 12:15:37 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:38 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" returned: 0 in 0.737s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:38 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" returned: 0 in 0.528s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:38 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87 Nov 03 12:15:38 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:38 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a Nov 03 12:15:38 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:38 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a" released by "delete_volume" :: held 0.986s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:38 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" returned: 0 in 0.423s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "cinder-quobyte-59c5570e-99d0-48e1-9ebb-5cbc9da44c87" released by "delete_volume" :: held 1.275s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Created reservations ['b5e50d2d-c472-4cce-8d5a-865e3514105a', 'fd6b1ecb-132d-40c0-874f-6b86222c7641', 'ff53eb72-0d60-4b07-ae95-ecd6e4d1aa45', '9b85c416-107f-403c-8112-858734c9fb48'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Created reservations ['26f77653-ee23-4900-b279-9fa4c0d37b81', 'c1e4c561-a234-469a-a6d5-b2e776afeeba', '0aa9b103-0113-4944-af92-ab665ab851cf', 'f9bff69c-a1e0-41ac-b2cf-264ecd498b4c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:39 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:39 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:39 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:39 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (605d01c5-61e8-4f78-aebd-359a82757801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee8aac-7275-4579-ac7a-1c1089ffe6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee8aac-7275-4579-ac7a-1c1089ffe6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1941053310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707d6d99-fca9-43d2-9ca7-7cc14e1ed55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:39Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c70134-4a80-473b-80d7-ef665363c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c70134-4a80-473b-80d7-ef665363c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f94895-c5fb-4fc3-9f9f-147f4d18bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f94895-c5fb-4fc3-9f9f-147f4d18bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707d6d99-fca9-43d2-9ca7-7cc14e1ed55d', 'volume_name': 'volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25846c04-1a7f-4a9f-93fd-c8402687cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25846c04-1a7f-4a9f-93fd-c8402687cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d9033a-0b47-4e24-8254-e674c637c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Volume 707d6d99-fca9-43d2-9ca7-7cc14e1ed55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d', 'volume_size': 1} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1941053310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707d6d99-fca9-43d2-9ca7-7cc14e1ed55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b283d7061e4c8b8a20d8f53f41c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:39Z,use_quota=True,user_id='2f855035a41f447d91143a11cd9dc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Creating volume 707d6d99-fca9-43d2-9ca7-7cc14e1ed55d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:39 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d 1073741824 Nov 03 12:15:39 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:39 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-23a9b03a-1e71-44f8-b7b4-48c1a7cbd6b9 tempest-VolumesGetTest-691376272 None] Lock "cinder-1adfb2f2-80cc-4239-87d7-36d3a5ae5b0a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:39 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.301s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Deleted volume successfully. Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a02a4aee-5195-4f79-a9f5-4cab6babf727 tempest-VolumeImageDependencyTests-1624242710 None] Lock "cinder-59c5570e-99d0-48e1-9ebb-5cbc9da44c87-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:39 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d 1073741824" returned: 0 in 0.494s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:39 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d Nov 03 12:15:39 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:40 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d9033a-0b47-4e24-8254-e674c637c761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4461584-2860-42e5-86c7-886c078bbb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Volume volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d (707d6d99-fca9-43d2-9ca7-7cc14e1ed55d): created successfully Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4461584-2860-42e5-86c7-886c078bbb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Flow 'volume_create_manager' (605d01c5-61e8-4f78-aebd-359a82757801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-25e3804b-7828-4705-9237-9d38335070d7 tempest-AttachVolumeNegativeTest-67719601 None] Created volume successfully. Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-619629b9-f84e-4332-981d-acd06a83336c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "cinder-619629b9-f84e-4332-981d-acd06a83336c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f694540-4ef2-4eca-948b-a0e75a29fd48]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:40 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c Nov 03 12:15:40 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:40 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c" returned: 0 in 0.402s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:40 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c Nov 03 12:15:40 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:40 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-619629b9-f84e-4332-981d-acd06a83336c" returned: 0 in 0.266s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-619629b9-f84e-4332-981d-acd06a83336c" released by "delete_volume" :: held 0.717s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Created reservations ['375bdcdb-6632-43be-bcc5-191516693b93', 'e1ba5686-c729-4322-aa9e-bf57a26587f9', '16a781ef-2ca0-429d-8512-8a40aff9871a', '4a4033a2-380b-4cd1-b9d5-56908d3f9ed9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:41 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:41 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-875aeebe-4704-4b56-a0e4-921d9b89a229-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "cinder-875aeebe-4704-4b56-a0e4-921d9b89a229-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:41 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.435s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-875aeebe-4704-4b56-a0e4-921d9b89a229" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28191be8-580d-4e5a-9a65-988f8c3b11c2 tempest-VolumesGetTest-691376272 None] Lock "cinder-619629b9-f84e-4332-981d-acd06a83336c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-875aeebe-4704-4b56-a0e4-921d9b89a229" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[661a962e-dcb8-48b7-9c88-b7206c41665a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:41 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:41 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3edf99fd-cfe8-4b15-aadf-57f1ffaf80f6 req-7a9a67a2-9016-4e9f-a0c1-530f9b8ade9e tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3edf99fd-cfe8-4b15-aadf-57f1ffaf80f6 req-7a9a67a2-9016-4e9f-a0c1-530f9b8ade9e tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3edf99fd-cfe8-4b15-aadf-57f1ffaf80f6 req-7a9a67a2-9016-4e9f-a0c1-530f9b8ade9e tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-3edf99fd-cfe8-4b15-aadf-57f1ffaf80f6 req-7a9a67a2-9016-4e9f-a0c1-530f9b8ade9e tempest-AttachVolumeNegativeTest-67719601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85f9b7ab-486b-49bf-82ea-5680ed4b1d2e', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:15:42 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.488s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:42 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229 Nov 03 12:15:42 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-3edf99fd-cfe8-4b15-aadf-57f1ffaf80f6 req-7a9a67a2-9016-4e9f-a0c1-530f9b8ade9e tempest-AttachVolumeNegativeTest-67719601 None] attachment_update completed successfully. Nov 03 12:15:42 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-875aeebe-4704-4b56-a0e4-921d9b89a229" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-875aeebe-4704-4b56-a0e4-921d9b89a229" released by "delete_volume" :: held 0.954s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Created reservations ['dd7ad17f-6806-47d1-884e-623399a35522', '52ca1f63-e0ec-4907-854f-8c45080c3c1b', '7cb7eaa8-e89c-473d-8c77-b412970e8e6d', 'c6c8a64d-950b-41e7-b4bd-8b9e6595106a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:42 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:42 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:43 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.315s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:43 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-210275ff-c9b8-4bb0-80b9-592cbe655dc8 tempest-VolumesGetTest-691376272 None] Lock "cinder-875aeebe-4704-4b56-a0e4-921d9b89a229-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (90a0ec44-40af-446a-b235-876147bcfeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2d348a-9454-4492-8a33-170cc41a1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2d348a-9454-4492-8a33-170cc41a1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-904786098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e66abb1-0530-4faf-8949-02d55948fa21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:45Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4c86a-b777-4975-8d81-bac483933835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4c86a-b777-4975-8d81-bac483933835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab02fc63-f5b7-4bb2-ae22-e7e380eb89f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:44 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Flow 'volume_create_manager' (709c3b17-f50d-4832-b732-e5d409df6b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c17bcc-2c51-4fe5-9708-9865941f996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c17bcc-2c51-4fe5-9708-9865941f996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10582720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67acf00d-ec88-4f6a-9e5a-a65b05acdc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc31d769353436c98bd34925435137f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:45Z,use_quota=True,user_id='7d19ac43f918425e98184355a9bf2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ccad3-1aa4-461b-a5cc-38d35d357935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ccad3-1aa4-461b-a5cc-38d35d357935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac1fef1-3b39-4e1c-b7ab-583ac0cb1ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac1fef1-3b39-4e1c-b7ab-583ac0cb1ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67acf00d-ec88-4f6a-9e5a-a65b05acdc1b', 'volume_name': 'volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9f001e-289c-42ea-85ee-1803fe6eb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9f001e-289c-42ea-85ee-1803fe6eb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b1ab6-0384-4411-a393-ec9d21c7c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Volume 67acf00d-ec88-4f6a-9e5a-a65b05acdc1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b', 'volume_size': 1} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10582720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67acf00d-ec88-4f6a-9e5a-a65b05acdc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc31d769353436c98bd34925435137f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:45Z,use_quota=True,user_id='7d19ac43f918425e98184355a9bf2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Creating volume 67acf00d-ec88-4f6a-9e5a-a65b05acdc1b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:45 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:45 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b 1073741824 Nov 03 12:15:45 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab02fc63-f5b7-4bb2-ae22-e7e380eb89f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e66abb1-0530-4faf-8949-02d55948fa21', 'volume_name': 'volume-1e66abb1-0530-4faf-8949-02d55948fa21', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f84505-3e4b-431e-b532-a50e2b7a1a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f84505-3e4b-431e-b532-a50e2b7a1a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318e875d-fcb4-4f32-8f57-fbe41bb7af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:45 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Volume 1e66abb1-0530-4faf-8949-02d55948fa21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e66abb1-0530-4faf-8949-02d55948fa21', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Trying to clone 1e66abb1-0530-4faf-8949-02d55948fa21 from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:15:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-29ee13f0-6e26-45a5-9708-720c1de6b8ab req-667273b4-7b7f-4f19-90c2-d83ead20491f tempest-AttachVolumeNegativeTest-67719601 None] Terminate volume connection completed successfully. Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-29ee13f0-6e26-45a5-9708-720c1de6b8ab req-667273b4-7b7f-4f19-90c2-d83ead20491f tempest-AttachVolumeNegativeTest-67719601 None] Deleting attachment 85f9b7ab-486b-49bf-82ea-5680ed4b1d2e. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:15:46 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b 1073741824" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:15:46 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:15:46 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b Nov 03 12:15:46 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2240b84-6b5f-4587-8a36-7120a3546dca]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:46 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD Nov 03 12:15:46 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:46 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" returned: 0 in 0.478s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b1ab6-0384-4411-a393-ec9d21c7c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a8677f-cf0f-4693-98af-53604c6a6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Volume volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b (67acf00d-ec88-4f6a-9e5a-a65b05acdc1b): created successfully Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a8677f-cf0f-4693-98af-53604c6a6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Flow 'volume_create_manager' (709c3b17-f50d-4832-b732-e5d409df6b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e7968ff7-0532-4f59-be2c-6990ca1104b2 tempest-ProjectReaderTests-1805960239 None] Created volume successfully. Nov 03 12:15:47 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 is fetched for user 341534a1cb1d467bb48941ff2f4c822f. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749a42d-d97f-4580-bdc9-b12a06d51910]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:47 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD Nov 03 12:15:47 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "cinder-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "cinder-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "cinder-quobyte-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "cinder-quobyte-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a812bf5e-63c5-4140-b906-c55ad4577b02]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:48 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-904786098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e66abb1-0530-4faf-8949-02d55948fa21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:45Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Creating volume 1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:48 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:48 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1073741824 Nov 03 12:15:48 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:48 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b Nov 03 12:15:48 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:48 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" returned: 0 in 0.620s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:48 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b Nov 03 12:15:48 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:48 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:48 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1073741824" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "cinder-quobyte-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b" released by "delete_volume" :: held 1.067s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Created reservations ['1c42a499-11ee-488c-8b10-85b6c83cc026', 'd59ee3f4-2d08-49f0-9611-ff4c63bcd865', 'a030d8cd-c120-4fcd-9b27-820299d099f6', 'c2e6d562-5e03-46dc-a903-36a7d61cbe9e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:49 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 Nov 03 12:15:49 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:49 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:49 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:49 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:49 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.311s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Deleted volume successfully. Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Attempting download of c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 1e66abb1-0530-4faf-8949-02d55948fa21. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1f483703-2a38-45c7-9ada-82b0860092a6 tempest-ProjectReaderTests-1805960239 None] Lock "cinder-67acf00d-ec88-4f6a-9e5a-a65b05acdc1b-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1e361a-73dd-4f18-9d76-19c9ed96aa17]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:49 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr Nov 03 12:15:49 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:49 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:50 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr Nov 03 12:15:50 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:50 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr" returned: 1 in 0.426s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_ru2glowr' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925f0c8-ec3b-42d6-b8e6-45db782b2db3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:50 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD Nov 03 12:15:50 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Flow 'volume_create_manager' (2e8db09d-2550-49b3-834d-9e6acc2dba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17a2681-2a51-45c8-af21-dadbc6a1f31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17a2681-2a51-45c8-af21-dadbc6a1f31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317874356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a373d9-b07d-49ca-9501-0520d0b0f6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc31d769353436c98bd34925435137f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:51Z,use_quota=True,user_id='7d19ac43f918425e98184355a9bf2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca844b1-f2af-41ee-a908-1740f6c34140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca844b1-f2af-41ee-a908-1740f6c34140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46b0b5b-0da0-45ce-b84f-f53d22fd82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46b0b5b-0da0-45ce-b84f-f53d22fd82ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a373d9-b07d-49ca-9501-0520d0b0f6b6', 'volume_name': 'volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704ee2ad-39ba-45bb-a49f-41b3be33ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704ee2ad-39ba-45bb-a49f-41b3be33ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acd4c44-a6d4-4b82-895a-5965d3d83e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Volume a8a373d9-b07d-49ca-9501-0520d0b0f6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6', 'volume_size': 1} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317874356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a373d9-b07d-49ca-9501-0520d0b0f6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc31d769353436c98bd34925435137f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:51Z,use_quota=True,user_id='7d19ac43f918425e98184355a9bf2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Creating volume a8a373d9-b07d-49ca-9501-0520d0b0f6b6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:50 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 1073741824 Nov 03 12:15:50 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:50 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:15:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:50 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 Nov 03 12:15:50 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:51 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 1073741824" returned: 0 in 0.473s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:51 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 Nov 03 12:15:51 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:51 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acd4c44-a6d4-4b82-895a-5965d3d83e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1aed43-a465-4c28-a8b7-b24805dc6daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Volume volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 (a8a373d9-b07d-49ca-9501-0520d0b0f6b6): created successfully Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1aed43-a465-4c28-a8b7-b24805dc6daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Flow 'volume_create_manager' (2e8db09d-2550-49b3-834d-9e6acc2dba89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-905fca02-537e-4983-b08a-de39c7d3b1d9 tempest-ProjectReaderTests-1805960239 None] Created volume successfully. Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-quobyte-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ce021-badb-4b59-adbe-481e120f9a04]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Acquiring lock "cinder-a8a373d9-b07d-49ca-9501-0520d0b0f6b6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "cinder-a8a373d9-b07d-49ca-9501-0520d0b0f6b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Acquiring lock "cinder-quobyte-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "cinder-quobyte-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:52 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d Nov 03 12:15:52 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a1b5c-03da-4280-9b85-ea6f1db1bbdb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:52 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21" returned: 0 in 2.167s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_jyaoirjxdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:15:52 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Converted 112.00 MB image at 51.66 MB/s Nov 03 12:15:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:52 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 Nov 03 12:15:52 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:52 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1G Nov 03 12:15:52 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:53 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" returned: 0 in 0.514s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:53 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d Nov 03 12:15:53 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:53 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" returned: 0 in 0.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:53 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6 Nov 03 12:15:53 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:53 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 1G" returned: 0 in 0.404s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Downloaded image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 1e66abb1-0530-4faf-8949-02d55948fa21 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 for user 341534a1cb1d467bb48941ff2f4c822f is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Marking volume 1e66abb1-0530-4faf-8949-02d55948fa21 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Copying metadata from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 to 1e66abb1-0530-4faf-8949-02d55948fa21. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Creating volume glance metadata for volume 1e66abb1-0530-4faf-8949-02d55948fa21 backed by image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:15:53 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d" released by "delete_volume" :: held 0.915s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318e875d-fcb4-4f32-8f57-fbe41bb7af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e66abb1-0530-4faf-8949-02d55948fa21', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829aaa3-4a86-4690-985a-dde13c5442c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Volume volume-1e66abb1-0530-4faf-8949-02d55948fa21 (1e66abb1-0530-4faf-8949-02d55948fa21): created successfully Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829aaa3-4a86-4690-985a-dde13c5442c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (90a0ec44-40af-446a-b235-876147bcfeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:53 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-28dc8cef-5523-447d-8d18-f5e114c6bdd6 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "cinder-quobyte-a8a373d9-b07d-49ca-9501-0520d0b0f6b6" released by "delete_volume" :: held 0.942s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Created reservations ['0c494246-a3d9-4b94-8d96-4b4bea2a2fd8', '05224248-1989-4dbc-87e3-95ea353f5d28', '223c2aa8-2abc-4622-953b-ac3077b46a0c', '18344528-9277-49f4-ae20-f7ba9373c285'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Created reservations ['13e96376-58db-4175-a917-cdfbb5fd49ec', '995ba7ff-7c34-4ef1-93c3-4ac3d78d9cf1', '904262b0-9f09-4866-8d9a-4f69509b6a10', 'ee609296-ca62-46ad-bf39-15e8a7e1d79c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:53 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:53 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:53 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:53 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:54 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.292s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Deleted volume successfully. Nov 03 12:15:54 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.271s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2be35346-86c6-4d6e-aa69-d3a03b62c912 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-707d6d99-fca9-43d2-9ca7-7cc14e1ed55d-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Deleted volume successfully. Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9ef96f92-96e2-42fd-8465-3ad9e4fb39fe tempest-ProjectReaderTests-1805960239 None] Lock "cinder-a8a373d9-b07d-49ca-9501-0520d0b0f6b6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-436fb23b-f4cc-45a7-8540-f135abcb13fb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-436fb23b-f4cc-45a7-8540-f135abcb13fb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-quobyte-436fb23b-f4cc-45a7-8540-f135abcb13fb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-436fb23b-f4cc-45a7-8540-f135abcb13fb" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3f3cd-f960-457e-8147-5586b783dc9a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:55 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb Nov 03 12:15:55 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:55 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb" returned: 0 in 0.533s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:55 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb Nov 03 12:15:55 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (dd3c08ea-3926-4583-bdf6-6da0ac8f32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4625bed-24df-4947-b520-262a14e4fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:55 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-436fb23b-f4cc-45a7-8540-f135abcb13fb" returned: 0 in 0.305s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4625bed-24df-4947-b520-262a14e4fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-805637332',display_name='tempest-VolumesGetTest-Volume-1107875042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c501a2d0-7d40-4a3d-a83c-72270c499517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:56Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ea6f83-f231-405c-bff0-a9c0d5418c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ea6f83-f231-405c-bff0-a9c0d5418c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1264387b-750d-4520-ae5e-067de34c4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1264387b-750d-4520-ae5e-067de34c4a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c501a2d0-7d40-4a3d-a83c-72270c499517', 'volume_name': 'volume-c501a2d0-7d40-4a3d-a83c-72270c499517', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090710f-5f84-42f5-94d6-962d8fbcb104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090710f-5f84-42f5-94d6-962d8fbcb104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ef62a0-a99e-45b4-b243-286b5ef6d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Volume c501a2d0-7d40-4a3d-a83c-72270c499517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c501a2d0-7d40-4a3d-a83c-72270c499517', 'volume_size': 1} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:15:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-805637332',display_name='tempest-VolumesGetTest-Volume-1107875042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c501a2d0-7d40-4a3d-a83c-72270c499517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec74c14f374995850a417c1076a50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:15:56Z,use_quota=True,user_id='341534a1cb1d467bb48941ff2f4c822f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Creating volume c501a2d0-7d40-4a3d-a83c-72270c499517 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:15:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-436fb23b-f4cc-45a7-8540-f135abcb13fb" released by "delete_volume" :: held 0.967s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:56 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 1073741824 Nov 03 12:15:56 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Created reservations ['46605092-0274-4996-bd8c-0f4935209629', '0467ba8c-d905-4c43-9813-dbb7100f9288', 'f73e47da-bb44-49f8-84e0-b962b2726651', '28d27857-741c-47e5-996d-e428b354c9ea'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:56 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:56 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:56 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.364s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Deleted volume successfully. Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eee29ad5-b0a5-48a8-a082-e628d977eecd tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-436fb23b-f4cc-45a7-8540-f135abcb13fb-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:56 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 1073741824" returned: 0 in 0.771s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:56 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 Nov 03 12:15:56 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:57 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ef62a0-a99e-45b4-b243-286b5ef6d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c501a2d0-7d40-4a3d-a83c-72270c499517', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590f2365-06b4-4035-a867-461a11c2651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:15:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Volume volume-c501a2d0-7d40-4a3d-a83c-72270c499517 (c501a2d0-7d40-4a3d-a83c-72270c499517): created successfully Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590f2365-06b4-4035-a867-461a11c2651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Flow 'volume_create_manager' (dd3c08ea-3926-4583-bdf6-6da0ac8f32ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:15:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f8c3a5af-fa7c-41d9-8002-4d9f5fc51c86 tempest-VolumesGetTest-691376272 None] Created volume successfully. Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "cinder-quobyte-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec322cb2-09d6-468f-bef0-36e4f85a41b7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:57 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf Nov 03 12:15:57 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-c501a2d0-7d40-4a3d-a83c-72270c499517-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:58 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" returned: 0 in 0.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "cinder-c501a2d0-7d40-4a3d-a83c-72270c499517-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:58 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf Nov 03 12:15:58 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-c501a2d0-7d40-4a3d-a83c-72270c499517" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-c501a2d0-7d40-4a3d-a83c-72270c499517" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[beab5796-9ed2-44be-a7e6-c629f7104b79]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:58 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 Nov 03 12:15:58 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:58 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" returned: 0 in 0.266s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-quobyte-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf" released by "delete_volume" :: held 0.734s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Created reservations ['be0d7814-b3ce-4c50-a5ee-b3ea4e314790', 'ef7e8a7f-dad6-47a8-8550-a7e48a93e3cb', '2fbf6873-647d-4caa-93ce-3e53d3c15489', '9743fe60-d921-4073-b5be-fe904b1bdb27'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:58 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:58 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:58 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517" returned: 0 in 0.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:58 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517 Nov 03 12:15:58 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:58 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Deleted volume successfully. Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b689bb7a-db6d-40ac-b812-739d712fb253 tempest-AttachVolumeNegativeTest-67719601 None] Lock "cinder-5a4a15c6-4821-4b63-b7ed-f8b1efa025cf-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:58 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c501a2d0-7d40-4a3d-a83c-72270c499517" returned: 0 in 0.286s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-c501a2d0-7d40-4a3d-a83c-72270c499517" released by "delete_volume" :: held 0.740s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Created reservations ['a8a67dd3-bbc6-48c9-b2f7-4f40ab46eb8b', 'ebcd4b3c-e9e2-4ecd-883c-c28f5422ce3e', 'cabd3efa-32cb-47ff-ac9a-4c003f984a06', 'df5ab1a3-3c3c-4574-8ddb-e80ec34ad958'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:59 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:15:59 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:59 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:15:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3d18113-6de8-4a5a-97d4-1d0d0c33f3c6 tempest-VolumesGetTest-691376272 None] Lock "cinder-c501a2d0-7d40-4a3d-a83c-72270c499517-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-1e66abb1-0530-4faf-8949-02d55948fa21-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "cinder-1e66abb1-0530-4faf-8949-02d55948fa21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=127,cinder:UPDATE=148,cinder:DELETE=15,cinder:INSERT=53 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=134,cinder:INSERT=44,cinder:UPDATE=179,cinder:DELETE=12 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Acquiring lock "cinder-quobyte-1e66abb1-0530-4faf-8949-02d55948fa21" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-1e66abb1-0530-4faf-8949-02d55948fa21" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6cbe60-0d98-4f30-852d-b5bf0cdac86f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:15:59 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 Nov 03 12:15:59 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:15:59 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21" returned: 0 in 0.445s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:00 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21 Nov 03 12:16:00 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:00 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1e66abb1-0530-4faf-8949-02d55948fa21" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "cinder-quobyte-1e66abb1-0530-4faf-8949-02d55948fa21" released by "delete_volume" :: held 0.763s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Created reservations ['bb68714c-da07-480c-b649-d716346861e0', '8cdce61c-fcac-4ae9-b6d8-2eac0ed329e7', '1e47aa29-037a-4023-ad06-b54969fbb051', '09e6718a-1609-4476-8447-820afc01c00c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:00 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:00 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:00 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Deleted volume successfully. Nov 03 12:16:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cb24a999-247a-488b-8454-9f1b8281dbd3 tempest-VolumesGetTest-691376272 None] Lock "cinder-1e66abb1-0530-4faf-8949-02d55948fa21-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Flow 'volume_create_manager' (0d0ab82d-2eab-4ac6-aee6-b1195afb0b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dde392-685c-4f7e-859e-a03f800f25cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dde392-685c-4f7e-859e-a03f800f25cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1341138203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acceaa6-34e8-40bd-a53c-28ad6dbdb035,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02edd518130049a9a85c8303cff10291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:07Z,use_quota=True,user_id='ece4d5d94fe24519bf720b07a6eb4792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec098288-6992-4d2e-bce4-21d0aaaf6847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec098288-6992-4d2e-bce4-21d0aaaf6847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023d4260-ba4f-41ef-98c9-186c3771064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023d4260-ba4f-41ef-98c9-186c3771064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1acceaa6-34e8-40bd-a53c-28ad6dbdb035', 'volume_name': 'volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8882513-37a4-4a4f-8084-c6952f522152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8882513-37a4-4a4f-8084-c6952f522152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7eeb7a-8099-4738-b644-e14ef354beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Volume 1acceaa6-34e8-40bd-a53c-28ad6dbdb035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035', 'volume_size': 1} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1341138203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acceaa6-34e8-40bd-a53c-28ad6dbdb035,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02edd518130049a9a85c8303cff10291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:07Z,use_quota=True,user_id='ece4d5d94fe24519bf720b07a6eb4792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Creating volume 1acceaa6-34e8-40bd-a53c-28ad6dbdb035 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:07 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 1073741824 Nov 03 12:16:07 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:08 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 1073741824" returned: 0 in 0.435s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:08 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 Nov 03 12:16:08 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:08 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7eeb7a-8099-4738-b644-e14ef354beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447c2e85-e4e1-40ad-b1f3-2cbe33d7d73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Volume volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 (1acceaa6-34e8-40bd-a53c-28ad6dbdb035): created successfully Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447c2e85-e4e1-40ad-b1f3-2cbe33d7d73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Flow 'volume_create_manager' (0d0ab82d-2eab-4ac6-aee6-b1195afb0b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-dc8884ba-05a5-457b-b44a-a5683c0953b3 req-49fbbdcd-3a2a-4b2e-9e66-1cd0e0ab2e1e tempest-VolumesGetTestJSON-1376727628 None] Created volume successfully. Nov 03 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Acquiring lock "cinder-1acceaa6-34e8-40bd-a53c-28ad6dbdb035-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "cinder-1acceaa6-34e8-40bd-a53c-28ad6dbdb035-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Acquiring lock "cinder-quobyte-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "cinder-quobyte-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e6884-24a7-498c-bb01-42afdb851cbe]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:09 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 Nov 03 12:16:09 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:09 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:09 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035 Nov 03 12:16:09 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:09 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "cinder-quobyte-1acceaa6-34e8-40bd-a53c-28ad6dbdb035" released by "delete_volume" :: held 0.689s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.quota [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Created reservations ['88b3d289-b2ce-44b2-8220-24bc5e62d6e2', 'aaf1b4e6-ddd6-4cec-9a07-ce1128fd9f6b', '4aeb061f-627b-4798-b84d-a2cf056d99b1', '71b9ec91-69b4-4b82-8dc8-addd751db091'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:09 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:09 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:10 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:10 devstack cinder-volume[86561]: DEBUG cinder.manager [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Deleted volume successfully. Nov 03 12:16:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-add1308b-8473-48dd-bb03-b1540c26f721 req-21fecea5-046b-4cb4-a263-f6e8e49d9fe6 tempest-VolumesGetTestJSON-1376727628 None] Lock "cinder-1acceaa6-34e8-40bd-a53c-28ad6dbdb035-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (73de8e2a-48cb-4c44-8a55-1ecd7814dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cd83ad-e5ad-429f-bc5e-0e7ead7cfc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cd83ad-e5ad-429f-bc5e-0e7ead7cfc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413174268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7894c1-e4ce-4a55-9490-bb339bc35e0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:14Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29f1a94-10a2-4ce9-9644-8b528fb07694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29f1a94-10a2-4ce9-9644-8b528fb07694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347c1e1-13f2-495c-a4a4-888f2d5d17de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347c1e1-13f2-495c-a4a4-888f2d5d17de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7894c1-e4ce-4a55-9490-bb339bc35e0f', 'volume_name': 'volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831c53ed-3525-42b6-a97c-8f740fe9a75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831c53ed-3525-42b6-a97c-8f740fe9a75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41babe6e-2c05-4632-99bf-9a529d29b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Volume db7894c1-e4ce-4a55-9490-bb339bc35e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f', 'volume_size': 1} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413174268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7894c1-e4ce-4a55-9490-bb339bc35e0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:14Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Creating volume db7894c1-e4ce-4a55-9490-bb339bc35e0f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:14 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:14 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f 1073741824 Nov 03 12:16:14 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:14 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f 1073741824" returned: 0 in 0.657s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:14 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f Nov 03 12:16:14 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:15 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41babe6e-2c05-4632-99bf-9a529d29b01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342dbf7c-e1bc-4632-9645-154490a1207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Volume volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f (db7894c1-e4ce-4a55-9490-bb339bc35e0f): created successfully Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342dbf7c-e1bc-4632-9645-154490a1207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (73de8e2a-48cb-4c44-8a55-1ecd7814dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2214c03e-0193-44ba-a976-faf4dd884768 tempest-VolumesTestJSON-582588632 None] Created volume successfully. Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (5d8fb70d-7ebc-47b1-a6ac-fad4643026bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acf7fb8-f3df-459a-8546-dc3540622aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acf7fb8-f3df-459a-8546-dc3540622aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-818676049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575360f3-a764-40e9-8a9a-3e51454812f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:17Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0ef34b-1272-422d-a5e4-5d8e57d4e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0ef34b-1272-422d-a5e4-5d8e57d4e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b5d1a-db7e-4333-8fd5-055b869f5555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b5d1a-db7e-4333-8fd5-055b869f5555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575360f3-a764-40e9-8a9a-3e51454812f1', 'volume_name': 'volume-575360f3-a764-40e9-8a9a-3e51454812f1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f66ca6-cd1f-4481-93e9-133bdf285375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f66ca6-cd1f-4481-93e9-133bdf285375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb5432-0bf2-4139-96b2-05b28ffcaf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Volume 575360f3-a764-40e9-8a9a-3e51454812f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575360f3-a764-40e9-8a9a-3e51454812f1', 'volume_size': 1} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-818676049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575360f3-a764-40e9-8a9a-3e51454812f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:17Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Creating volume 575360f3-a764-40e9-8a9a-3e51454812f1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:16 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:17 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 1073741824 Nov 03 12:16:17 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:17 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 1073741824" returned: 0 in 0.515s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:17 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 Nov 03 12:16:17 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:17 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1" returned: 0 in 0.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb5432-0bf2-4139-96b2-05b28ffcaf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575360f3-a764-40e9-8a9a-3e51454812f1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218a95d9-e598-4b4c-ab71-e6d533965665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Volume volume-575360f3-a764-40e9-8a9a-3e51454812f1 (575360f3-a764-40e9-8a9a-3e51454812f1): created successfully Nov 03 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218a95d9-e598-4b4c-ab71-e6d533965665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (5d8fb70d-7ebc-47b1-a6ac-fad4643026bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b1ca401c-41a1-4e49-a3a5-b8e260715852 tempest-VolumesTestJSON-582588632 None] Created volume successfully. Nov 03 12:16:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (5cf8dc9c-9feb-45d8-91c7-78e77b4c8256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f41dee-9324-4720-a874-1bed60e96083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f41dee-9324-4720-a874-1bed60e96083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-273383669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509995de-d784-4f5e-b525-a60315606d72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:20Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb424ad4-6e92-453d-b68c-be2a18e1bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb424ad4-6e92-453d-b68c-be2a18e1bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8707f76a-f647-44a4-90dd-fbbb6ef5bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8707f76a-f647-44a4-90dd-fbbb6ef5bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509995de-d784-4f5e-b525-a60315606d72', 'volume_name': 'volume-509995de-d784-4f5e-b525-a60315606d72', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137f59e-8910-424c-b230-d8e7256711f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137f59e-8910-424c-b230-d8e7256711f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe2b9e1-5613-4dbb-b4c5-5a4e30d9cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Volume 509995de-d784-4f5e-b525-a60315606d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509995de-d784-4f5e-b525-a60315606d72', 'volume_size': 1} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-273383669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509995de-d784-4f5e-b525-a60315606d72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='191a00a1e1a64a2d82eb7633981b7638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:20Z,use_quota=True,user_id='bcd20fb0a15a4e3f92b15520c14d39e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Creating volume 509995de-d784-4f5e-b525-a60315606d72 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:20 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:20 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 1073741824 Nov 03 12:16:20 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-864abc75-aa66-406e-b703-e43d7abd502c req-4b275423-f7b2-4cc2-8e21-7f1d3c24ccd7 tempest-TestMinimumBasicScenario-1275035272 None] Terminate volume connection completed successfully. Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-864abc75-aa66-406e-b703-e43d7abd502c req-4b275423-f7b2-4cc2-8e21-7f1d3c24ccd7 tempest-TestMinimumBasicScenario-1275035272 None] Deleting attachment b08d353c-f299-44f7-ace0-f1182200bed1. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:16:20 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 1073741824" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:20 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 Nov 03 12:16:20 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "cinder-a988f908-c853-403e-a061-67bb44e6ad93-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "cinder-a988f908-c853-403e-a061-67bb44e6ad93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe2b9e1-5613-4dbb-b4c5-5a4e30d9cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509995de-d784-4f5e-b525-a60315606d72', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e15108c-cb4b-4f9e-bb27-87bd942a256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Volume volume-509995de-d784-4f5e-b525-a60315606d72 (509995de-d784-4f5e-b525-a60315606d72): created successfully Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e15108c-cb4b-4f9e-bb27-87bd942a256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Flow 'volume_create_manager' (5cf8dc9c-9feb-45d8-91c7-78e77b4c8256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-daf053fd-1d19-41dd-93ef-047ef7046822 tempest-VolumesTestJSON-582588632 None] Created volume successfully. Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "cinder-quobyte-a988f908-c853-403e-a061-67bb44e6ad93" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "cinder-quobyte-a988f908-c853-403e-a061-67bb44e6ad93" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c212b14e-984c-42a0-ae25-aa450fd6af14]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:21 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 Nov 03 12:16:21 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:21 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:21 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93 Nov 03 12:16:21 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:21 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a988f908-c853-403e-a061-67bb44e6ad93" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "cinder-quobyte-a988f908-c853-403e-a061-67bb44e6ad93" released by "delete_volume" :: held 0.693s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Created reservations ['4e2e45a3-b106-40d4-95fd-161b11afd2d8', '3b3832fa-eb09-4f22-a8cf-82333529b00b', '93c022fe-af5c-47c1-b63e-baf4dd9bee5a', '34fecbe6-4f76-4798-a2fd-000853386103'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:22 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:22 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:22 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Deleted volume successfully. Nov 03 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1b05eec1-b48c-4c62-b420-ee55348a502f tempest-TestMinimumBasicScenario-1275035272 None] Lock "cinder-a988f908-c853-403e-a061-67bb44e6ad93-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-509995de-d784-4f5e-b525-a60315606d72-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "cinder-509995de-d784-4f5e-b525-a60315606d72-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-quobyte-509995de-d784-4f5e-b525-a60315606d72" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-509995de-d784-4f5e-b525-a60315606d72" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed3eafe-e046-41af-8da2-504ef840eba9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:23 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 Nov 03 12:16:23 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:23 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72" returned: 0 in 0.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:23 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72 Nov 03 12:16:23 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:24 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:24 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:24 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-509995de-d784-4f5e-b525-a60315606d72" returned: 0 in 0.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-509995de-d784-4f5e-b525-a60315606d72" released by "delete_volume" :: held 0.867s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Created reservations ['cec7af4d-0c12-462b-96ed-14ffee5f4b1b', '7900105a-29dd-4ef0-a36c-2fe3bd4e1d8d', '4f1f9530-ac97-4f60-9037-b745664b407f', 'd519ed84-3beb-451b-91e4-e02033911962'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:24 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:24 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:24 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:24 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.368s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Deleted volume successfully. Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e1d75bd-251d-4d24-97a4-72d47778c8d5 tempest-VolumesTestJSON-582588632 None] Lock "cinder-509995de-d784-4f5e-b525-a60315606d72-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-575360f3-a764-40e9-8a9a-3e51454812f1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "cinder-575360f3-a764-40e9-8a9a-3e51454812f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-quobyte-575360f3-a764-40e9-8a9a-3e51454812f1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-575360f3-a764-40e9-8a9a-3e51454812f1" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[461edaaf-1f73-497b-9bff-1c41ed517990]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:25 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 Nov 03 12:16:25 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:26 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1" returned: 0 in 0.391s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:26 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1 Nov 03 12:16:26 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:26 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-575360f3-a764-40e9-8a9a-3e51454812f1" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-575360f3-a764-40e9-8a9a-3e51454812f1" released by "delete_volume" :: held 0.764s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Created reservations ['07b5847b-69df-45b3-a4c5-3685fac4bf43', '511f503b-3301-4f5f-864c-0b8725c5e2ed', '3de2a9c2-a57b-4450-98cb-ffcb59517b94', '0db12b33-ef99-4ab1-a114-28e1ea7ae1b8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:26 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:26 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-db7894c1-e4ce-4a55-9490-bb339bc35e0f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "cinder-db7894c1-e4ce-4a55-9490-bb339bc35e0f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Acquiring lock "cinder-quobyte-db7894c1-e4ce-4a55-9490-bb339bc35e0f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-db7894c1-e4ce-4a55-9490-bb339bc35e0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4ce97-1cd1-4c8d-93de-e294301da07a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:27 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.368s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Deleted volume successfully. Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-824d2ea9-35c2-4e02-bdf8-3a6b37abc277 tempest-VolumesTestJSON-582588632 None] Lock "cinder-575360f3-a764-40e9-8a9a-3e51454812f1-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:27 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f Nov 03 12:16:27 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:27 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f" returned: 0 in 0.422s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:27 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f Nov 03 12:16:27 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:27 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-db7894c1-e4ce-4a55-9490-bb339bc35e0f" returned: 0 in 0.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "cinder-quobyte-db7894c1-e4ce-4a55-9490-bb339bc35e0f" released by "delete_volume" :: held 0.782s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Created reservations ['1b2be39d-a3ac-46b8-9099-18cc18bdb19c', '11afc6a1-72d2-4979-91a8-45394e9eb4d6', '59dc7004-07f1-4aa7-8cfa-01ed94bfff6b', '5c3dfd44-e68e-47a2-a62b-8f3e6a634f82'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:28 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:28 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:28 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Deleted volume successfully. Nov 03 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce800c08-2f81-4324-acbc-1944f55bc804 tempest-VolumesTestJSON-582588632 None] Lock "cinder-db7894c1-e4ce-4a55-9490-bb339bc35e0f-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Flow 'volume_create_manager' (17f468d9-289a-4d09-858a-0142054d9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551d663d-72fa-4601-ba2b-b146f52c2dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551d663d-72fa-4601-ba2b-b146f52c2dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623703532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221ba610-4bd5-4040-9c4a-14a66f8624a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4107aca340f246cbaf3bacd575ec3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:30Z,use_quota=True,user_id='4c093918a9214f218959b047e6381a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bbaaf6-8ea2-426f-bec7-bc3f55e2b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bbaaf6-8ea2-426f-bec7-bc3f55e2b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4a28fb-d92c-4ba3-8688-3cfc3a91bfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4a28fb-d92c-4ba3-8688-3cfc3a91bfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221ba610-4bd5-4040-9c4a-14a66f8624a8', 'volume_name': 'volume-221ba610-4bd5-4040-9c4a-14a66f8624a8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719a47fa-add9-41f1-90dd-092555ea9237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719a47fa-add9-41f1-90dd-092555ea9237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72f6fd5-6f43-45bd-9a3b-63ab38d3eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume 221ba610-4bd5-4040-9c4a-14a66f8624a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221ba610-4bd5-4040-9c4a-14a66f8624a8', 'volume_size': 1} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623703532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221ba610-4bd5-4040-9c4a-14a66f8624a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4107aca340f246cbaf3bacd575ec3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:30Z,use_quota=True,user_id='4c093918a9214f218959b047e6381a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Creating volume 221ba610-4bd5-4040-9c4a-14a66f8624a8 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:29 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 1073741824 Nov 03 12:16:29 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Flow 'volume_create_manager' (69251ff3-24dc-4cc4-849f-0d2e9d1833e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f37947d-1bba-4b9d-b343-09014144eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f37947d-1bba-4b9d-b343-09014144eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1813022067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c6d064-68a2-4f7d-8088-58a3dc8e21fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4107aca340f246cbaf3bacd575ec3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:30Z,use_quota=True,user_id='4c093918a9214f218959b047e6381a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5085a935-df39-4378-a233-977d09d6f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5085a935-df39-4378-a233-977d09d6f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8fd57-0201-4a7d-9afd-689e6cb4d638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8fd57-0201-4a7d-9afd-689e6cb4d638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c6d064-68a2-4f7d-8088-58a3dc8e21fd', 'volume_name': 'volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73732833-efeb-42ba-ad86-5c7dc02c1fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73732833-efeb-42ba-ad86-5c7dc02c1fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c80bc-bf19-4094-bff3-3586f79ceb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume 12c6d064-68a2-4f7d-8088-58a3dc8e21fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd', 'volume_size': 1} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:30 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 1073741824" returned: 0 in 0.648s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:30 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 Nov 03 12:16:30 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:30 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8" returned: 0 in 0.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1813022067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c6d064-68a2-4f7d-8088-58a3dc8e21fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4107aca340f246cbaf3bacd575ec3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:30Z,use_quota=True,user_id='4c093918a9214f218959b047e6381a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Creating volume 12c6d064-68a2-4f7d-8088-58a3dc8e21fd {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:30 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72f6fd5-6f43-45bd-9a3b-63ab38d3eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221ba610-4bd5-4040-9c4a-14a66f8624a8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd 1073741824 Nov 03 12:16:30 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4397b3de-f3e8-4061-aab8-5edd138badfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 (221ba610-4bd5-4040-9c4a-14a66f8624a8): created successfully Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4397b3de-f3e8-4061-aab8-5edd138badfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Flow 'volume_create_manager' (17f468d9-289a-4d09-858a-0142054d9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a06c803a-49a5-4d6d-99b0-3152a7dd2277 tempest-TestServerVolumeAttachmentScenario-123340879 None] Created volume successfully. Nov 03 12:16:31 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd 1073741824" returned: 0 in 0.575s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:31 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd Nov 03 12:16:31 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:31 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" returned: 0 in 0.305s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c80bc-bf19-4094-bff3-3586f79ceb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c745be-a783-4028-8e0a-27732209f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Volume volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd (12c6d064-68a2-4f7d-8088-58a3dc8e21fd): created successfully Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c745be-a783-4028-8e0a-27732209f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Flow 'volume_create_manager' (69251ff3-24dc-4cc4-849f-0d2e9d1833e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-70121a8f-8ab8-4f9d-b1e9-f067d8af439c tempest-TestServerVolumeAttachmentScenario-123340879 None] Created volume successfully. Nov 03 12:16:41 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=61,cinder:DELETE=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:16:41 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=43,cinder:INSERT=16,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Flow 'volume_create_manager' (a02bcea7-2ed1-46fe-887a-cd557befddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff01eae6-7b0b-42ad-8d9d-44018fb14036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff01eae6-7b0b-42ad-8d9d-44018fb14036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-504767342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0e6683-4dbb-40b8-81c7-3f72b805a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a56ee774fbf4819b9aecdb46a8820c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:52Z,use_quota=True,user_id='fa1b4949df984e4583f328823a0b4196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3be452a4-caf0-45c5-950d-7dbed887ec97),volume_type_id=3be452a4-caf0-45c5-950d-7dbed887ec97)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd7bde-24cb-4a23-8262-6c6f116622b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd7bde-24cb-4a23-8262-6c6f116622b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467039c2-aadc-4276-885a-c2e6bc62f2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467039c2-aadc-4276-885a-c2e6bc62f2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0e6683-4dbb-40b8-81c7-3f72b805a33c', 'volume_name': 'volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c86263a-cb88-43a2-b608-ca1c4ce148d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c86263a-cb88-43a2-b608-ca1c4ce148d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a6a09c-8ff8-45cb-83b8-17e7fe3f526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Volume 1c0e6683-4dbb-40b8-81c7-3f72b805a33c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c', 'volume_size': 1} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-504767342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0e6683-4dbb-40b8-81c7-3f72b805a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a56ee774fbf4819b9aecdb46a8820c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:16:52Z,use_quota=True,user_id='fa1b4949df984e4583f328823a0b4196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3be452a4-caf0-45c5-950d-7dbed887ec97),volume_type_id=3be452a4-caf0-45c5-950d-7dbed887ec97)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Creating volume 1c0e6683-4dbb-40b8-81c7-3f72b805a33c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:16:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:52 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c 1073741824 Nov 03 12:16:52 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:52 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c 1073741824" returned: 0 in 0.540s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:52 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c Nov 03 12:16:52 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:52 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" returned: 0 in 0.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a6a09c-8ff8-45cb-83b8-17e7fe3f526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8aaad9-d3d3-4e9a-91d2-90ea87b0ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:16:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Volume volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c (1c0e6683-4dbb-40b8-81c7-3f72b805a33c): created successfully Nov 03 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8aaad9-d3d3-4e9a-91d2-90ea87b0ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Flow 'volume_create_manager' (a02bcea7-2ed1-46fe-887a-cd557befddb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:16:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-949ab501-a61c-419f-a295-b146f5ab4ddc tempest-VolumeTypesAccessTest-1075538222 None] Created volume successfully. Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Acquiring lock "cinder-1c0e6683-4dbb-40b8-81c7-3f72b805a33c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "cinder-1c0e6683-4dbb-40b8-81c7-3f72b805a33c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Acquiring lock "cinder-quobyte-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "cinder-quobyte-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d40ca9-bed1-459c-8ad9-aa803ee576e1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:54 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c Nov 03 12:16:54 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:54 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:54 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c Nov 03 12:16:54 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:55 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" returned: 0 in 0.258s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "cinder-quobyte-1c0e6683-4dbb-40b8-81c7-3f72b805a33c" released by "delete_volume" :: held 0.680s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:16:55 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-733433169 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-733433169, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:16:55 devstack cinder-volume[86561]: WARNING cinder.quota [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-733433169 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-733433169, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Created reservations ['65b5396d-47f1-46c4-8550-0dd66672031d', 'f57e3f8e-88a2-480e-8d96-5ad548d30988', '17ddbaa1-a821-497b-85d7-83f2323921a9', 'a73e5996-0a36-4f09-a469-d0c40a791b93'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:16:55 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:16:55 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:16:55 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:16:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Deleted volume successfully. Nov 03 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a0af82a8-2e66-4f4f-a1be-bc09fb19305b tempest-VolumeTypesAccessTest-1075538222 None] Lock "cinder-1c0e6683-4dbb-40b8-81c7-3f72b805a33c-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d33953b3-c027-4525-9de3-fca1883cfe0e req-45e05bb2-473a-42fe-abec-a8d2be1c1e93 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d33953b3-c027-4525-9de3-fca1883cfe0e req-45e05bb2-473a-42fe-abec-a8d2be1c1e93 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d33953b3-c027-4525-9de3-fca1883cfe0e req-45e05bb2-473a-42fe-abec-a8d2be1c1e93 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-d33953b3-c027-4525-9de3-fca1883cfe0e req-45e05bb2-473a-42fe-abec-a8d2be1c1e93 tempest-TestServerVolumeAttachmentScenario-123340879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-221ba610-4bd5-4040-9c4a-14a66f8624a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0af556f-f3e1-4477-89e0-26a975049262', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:17:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-d33953b3-c027-4525-9de3-fca1883cfe0e req-45e05bb2-473a-42fe-abec-a8d2be1c1e93 tempest-TestServerVolumeAttachmentScenario-123340879 None] attachment_update completed successfully. Nov 03 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-183f53f6-e9aa-4bf1-bcd3-32d37fa84847 req-21a0d276-6b06-4a87-a065-6ea42744ba52 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-183f53f6-e9aa-4bf1-bcd3-32d37fa84847 req-21a0d276-6b06-4a87-a065-6ea42744ba52 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-183f53f6-e9aa-4bf1-bcd3-32d37fa84847 req-21a0d276-6b06-4a87-a065-6ea42744ba52 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-183f53f6-e9aa-4bf1-bcd3-32d37fa84847 req-21a0d276-6b06-4a87-a065-6ea42744ba52 tempest-TestServerVolumeAttachmentScenario-123340879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d17f4c0-69fb-48a3-801d-28039cc15b32', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:17:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-183f53f6-e9aa-4bf1-bcd3-32d37fa84847 req-21a0d276-6b06-4a87-a065-6ea42744ba52 tempest-TestServerVolumeAttachmentScenario-123340879 None] attachment_update completed successfully. Nov 03 12:17:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-25f6d3d1-fcf9-4816-a88e-7ca85d8b615d req-8ede0ac0-5e55-405b-a246-468fd112f8db tempest-TestServerVolumeAttachmentScenario-123340879 None] Terminate volume connection completed successfully. Nov 03 12:17:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-25f6d3d1-fcf9-4816-a88e-7ca85d8b615d req-8ede0ac0-5e55-405b-a246-468fd112f8db tempest-TestServerVolumeAttachmentScenario-123340879 None] Deleting attachment 2d17f4c0-69fb-48a3-801d-28039cc15b32. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:17:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-80c5391c-885e-41af-9769-0818ba9f77ff req-ad99d21a-864b-450a-8150-1b80406e302a tempest-TestServerVolumeAttachmentScenario-123340879 None] Terminate volume connection completed successfully. Nov 03 12:17:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-80c5391c-885e-41af-9769-0818ba9f77ff req-ad99d21a-864b-450a-8150-1b80406e302a tempest-TestServerVolumeAttachmentScenario-123340879 None] Deleting attachment b0af556f-f3e1-4477-89e0-26a975049262. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "cinder-12c6d064-68a2-4f7d-8088-58a3dc8e21fd-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-12c6d064-68a2-4f7d-8088-58a3dc8e21fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "cinder-quobyte-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-quobyte-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[609357b0-12df-47ec-9193-897c4b78845a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:22 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd Nov 03 12:17:22 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:22 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" returned: 0 in 0.424s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:22 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd Nov 03 12:17:22 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:23 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-quobyte-12c6d064-68a2-4f7d-8088-58a3dc8e21fd" released by "delete_volume" :: held 0.782s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Created reservations ['8c8ca6b6-4308-4828-b05a-6c3fc29bf3f5', 'd0ef560c-6129-4452-9050-32f615f8544d', 'abb4f89c-b48f-425c-b849-038498eb4417', '4f3f375a-6323-49e8-a859-4effb838e171'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:23 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:23 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "cinder-221ba610-4bd5-4040-9c4a-14a66f8624a8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-221ba610-4bd5-4040-9c4a-14a66f8624a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Flow 'volume_create_manager' (a4585687-e733-4da0-9779-b6eb42213c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ad7ecf-ace5-474b-bebc-b76ea3106276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ad7ecf-ace5-474b-bebc-b76ea3106276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-110175043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d08d47d-6485-4d12-bf1e-2122e404c7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c7e389e6204282a04f4a2502c8b6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:24Z,use_quota=True,user_id='dea18d6259f94b66aa5c3d0fa906cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:23 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d950643-b998-4f1e-84d1-57b7fff15160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d950643-b998-4f1e-84d1-57b7fff15160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946835bb-d3c2-4de7-bb2a-85b6a502e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946835bb-d3c2-4de7-bb2a-85b6a502e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d08d47d-6485-4d12-bf1e-2122e404c7c3', 'volume_name': 'volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1987cc24-190e-4452-82fc-c919461edbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1987cc24-190e-4452-82fc-c919461edbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb00ff7-9925-4ee3-bd63-e8d542f209b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Volume 7d08d47d-6485-4d12-bf1e-2122e404c7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3', 'volume_size': 1} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-110175043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d08d47d-6485-4d12-bf1e-2122e404c7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c7e389e6204282a04f4a2502c8b6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:24Z,use_quota=True,user_id='dea18d6259f94b66aa5c3d0fa906cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Creating volume 7d08d47d-6485-4d12-bf1e-2122e404c7c3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.470s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:23 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 1073741824 Nov 03 12:17:23 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Deleted volume successfully. Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "cinder-quobyte-221ba610-4bd5-4040-9c4a-14a66f8624a8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6f52efc-ac6d-461f-af4a-2a8b2c1aa153 tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-12c6d064-68a2-4f7d-8088-58a3dc8e21fd-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-quobyte-221ba610-4bd5-4040-9c4a-14a66f8624a8" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8be080-639a-4f87-b6dd-8ce85067eb78]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:24 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 Nov 03 12:17:24 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:24 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:24 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:24 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:24 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8" returned: 0 in 0.540s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:17:24 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8 Nov 03 12:17:24 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:24 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 1073741824" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:24 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 Nov 03 12:17:24 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:24 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-221ba610-4bd5-4040-9c4a-14a66f8624a8" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-quobyte-221ba610-4bd5-4040-9c4a-14a66f8624a8" released by "delete_volume" :: held 0.985s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Created reservations ['21211180-2a42-4f4a-9a41-8f4a0a5ed944', '1517518f-8692-4675-a6be-72fe1bb17a9d', '74d492cc-0984-4f5c-9532-163daebeff07', '1eb8226f-c0a7-479e-b2c8-40e78a2500b5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:25 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3" returned: 0 in 0.502s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:25 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb00ff7-9925-4ee3-bd63-e8d542f209b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:25 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c13e96-9b2f-4bff-a5a8-f1011b0c8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Volume volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 (7d08d47d-6485-4d12-bf1e-2122e404c7c3): created successfully Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c13e96-9b2f-4bff-a5a8-f1011b0c8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Flow 'volume_create_manager' (a4585687-e733-4da0-9779-b6eb42213c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-20e9559d-1be0-40b6-b004-0e2c366ef4f7 tempest-VolumesTransfersV355Test-1512330341 None] Created volume successfully. Nov 03 12:17:25 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Deleted volume successfully. Nov 03 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7edaa0a-b6ac-4360-aace-6f21b6ff703c tempest-TestServerVolumeAttachmentScenario-123340879 None] Lock "cinder-221ba610-4bd5-4040-9c4a-14a66f8624a8-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b56aaefb-8d0b-4b77-a613-84d121253164 tempest-VolumesTransfersV355Test-540302212 None] Transfer volume completed successfully. Nov 03 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "cinder-7d08d47d-6485-4d12-bf1e-2122e404c7c3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-7d08d47d-6485-4d12-bf1e-2122e404c7c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "cinder-quobyte-7d08d47d-6485-4d12-bf1e-2122e404c7c3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-quobyte-7d08d47d-6485-4d12-bf1e-2122e404c7c3" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[67974a66-976a-4884-ac70-3d8d6ad56b47]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:27 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 Nov 03 12:17:27 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:27 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3" returned: 0 in 0.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:27 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3 Nov 03 12:17:27 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:27 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7d08d47d-6485-4d12-bf1e-2122e404c7c3" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-quobyte-7d08d47d-6485-4d12-bf1e-2122e404c7c3" released by "delete_volume" :: held 0.767s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Created reservations ['63ba0f72-4eb5-4ebf-847d-cfdb261ceef9', '17d97f3a-4228-4f27-a864-0123c9dcecd6', '7f876949-6c6c-4f48-bf7b-8526645c794f', '0355161f-a198-406b-8033-c038ea7c983e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:27 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:27 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:28 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Deleted volume successfully. Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2921f269-9e40-4d92-b853-0760182d6faf tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-7d08d47d-6485-4d12-bf1e-2122e404c7c3-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Flow 'volume_create_manager' (907452ce-2227-4556-9462-6d020afa1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2d2775-539f-4057-bae7-12bfcb8a0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2d2775-539f-4057-bae7-12bfcb8a0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-192496368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c7e389e6204282a04f4a2502c8b6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:29Z,use_quota=True,user_id='dea18d6259f94b66aa5c3d0fa906cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49428d92-d563-46b7-bb87-615acca1f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49428d92-d563-46b7-bb87-615acca1f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa092d3b-e7e5-4816-8e68-053bcc3b3bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa092d3b-e7e5-4816-8e68-053bcc3b3bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f', 'volume_name': 'volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6972d67-568e-4e4e-b027-a6c7a73655fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6972d67-568e-4e4e-b027-a6c7a73655fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9e6477-b683-4841-a0b0-1162246cfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Volume 4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f', 'volume_size': 1} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-192496368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c7e389e6204282a04f4a2502c8b6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:29Z,use_quota=True,user_id='dea18d6259f94b66aa5c3d0fa906cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Creating volume 4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:29 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f 1073741824 Nov 03 12:17:29 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:29 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f 1073741824" returned: 0 in 0.398s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:29 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f Nov 03 12:17:29 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:29 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" returned: 0 in 0.285s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9e6477-b683-4841-a0b0-1162246cfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f694eaf-698e-46af-9b4f-07c49904b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Volume volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f (4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f): created successfully Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f694eaf-698e-46af-9b4f-07c49904b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Flow 'volume_create_manager' (907452ce-2227-4556-9462-6d020afa1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b04f1bc0-4c99-4881-9f46-93e3e9d06ece tempest-VolumesTransfersV355Test-1512330341 None] Created volume successfully. Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "cinder-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "cinder-quobyte-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-quobyte-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52b098-a92e-4469-844a-5f24262e6087]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:31 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f Nov 03 12:17:31 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:31 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" returned: 0 in 0.443s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:32 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f Nov 03 12:17:32 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:32 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-quobyte-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f" released by "delete_volume" :: held 0.831s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Created reservations ['eda2368b-e4ac-4dd5-873e-e24faa96b6e0', '6746e0e1-1daa-4f37-b9ef-bec16b96d09d', '81f1ea87-906e-41bf-8d58-67dd5db5fa5c', '76a5c527-5ac1-4d6c-a541-5810122211ac'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:32 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:32 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:32 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Deleted volume successfully. Nov 03 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ef98db4-d033-457f-aec7-45f1f5275c9b tempest-VolumesTransfersV355Test-63543078 None] Lock "cinder-4ae304fd-4b74-4a7e-9c5c-8f9d2ad7fe0f-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Flow 'volume_create_manager' (7f4ad703-92df-468d-b703-117200bd0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a824a492-9741-47d9-955f-8113d50e0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a824a492-9741-47d9-955f-8113d50e0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270986476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d921f60e-eda2-424a-987e-2145aefe3c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554f7704d41745018f78959746c89658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:40Z,use_quota=True,user_id='0531d961eda1478d8fb4be9f13f2a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7050d1-0d92-43c2-8c05-db448e7391b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7050d1-0d92-43c2-8c05-db448e7391b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e853cca2-c286-49d5-b5b1-bd881261118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e853cca2-c286-49d5-b5b1-bd881261118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd921f60e-eda2-424a-987e-2145aefe3c48', 'volume_name': 'volume-d921f60e-eda2-424a-987e-2145aefe3c48', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b5fcac-7cc6-4364-a99b-ed2180d43bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b5fcac-7cc6-4364-a99b-ed2180d43bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70143b9c-94d8-40c8-9b1e-2e741f0134a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Volume d921f60e-eda2-424a-987e-2145aefe3c48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d921f60e-eda2-424a-987e-2145aefe3c48', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Trying to clone d921f60e-eda2-424a-987e-2145aefe3c48 from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:17:40 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f18421-3582-4179-83b9-e3a9a94850ea]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:40 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD Nov 03 12:17:40 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:41 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 is fetched for user 0531d961eda1478d8fb4be9f13f2a3c9. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[54930b0d-3068-4868-b260-39c7a38db2c4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:41 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD Nov 03 12:17:41 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:41 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270986476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d921f60e-eda2-424a-987e-2145aefe3c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554f7704d41745018f78959746c89658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:40Z,use_quota=True,user_id='0531d961eda1478d8fb4be9f13f2a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Creating volume d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:41 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:41 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1073741824 Nov 03 12:17:41 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:42 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1073741824" returned: 0 in 0.482s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:42 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 Nov 03 12:17:42 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Flow 'volume_create_manager' (e116bb39-fe36-4316-8358-89ae0f2d53a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:42 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e6bb63-e7ce-4001-92bf-4ea27dce0f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e6bb63-e7ce-4001-92bf-4ea27dce0f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb15a85-c733-409d-af44-f40d051e27b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230cac22ba0d48ceae3909ff0ccaf5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:42Z,use_quota=True,user_id='cab5d035bf6b4e80981669437518e27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6b40f07-eb52-489e-b966-a475eaa760c4),volume_type_id=f6b40f07-eb52-489e-b966-a475eaa760c4)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6a9fdf-dbc5-4757-99fa-234b91a131cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6a9fdf-dbc5-4757-99fa-234b91a131cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299147d1-a533-4d76-b191-490085100d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Attempting download of c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume d921f60e-eda2-424a-987e-2145aefe3c48. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8712d3a0-7ee4-45e2-88a8-40820756ae53]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:42 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw Nov 03 12:17:42 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299147d1-a533-4d76-b191-490085100d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cb15a85-c733-409d-af44-f40d051e27b0', 'volume_name': 'volume-0cb15a85-c733-409d-af44-f40d051e27b0', 'volume_size': 1, 'image_id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79b8591e0e1722fe39582407573e02b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '230cac22ba0d48ceae3909ff0ccaf5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c4c059035ab3f4ce8668daf6ccccb36537b86d8f0d83e719432467ca41d4e9960b37fac8548f04c3af10e356d9ea9febbaaf29c6d6cbdd0862a5adc138c4e6c', 'id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'created_at': datetime.datetime(2026, 11, 3, 11, 17, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 17, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f5af533-dfbd-492d-9f13-8420968a5390/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c9e7e-f262-4072-b35f-ce3da2b53a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c9e7e-f262-4072-b35f-ce3da2b53a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afb2815-785b-4207-8930-8d0d32ef60d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Volume 0cb15a85-c733-409d-af44-f40d051e27b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cb15a85-c733-409d-af44-f40d051e27b0', 'volume_size': 1, 'image_id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79b8591e0e1722fe39582407573e02b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '230cac22ba0d48ceae3909ff0ccaf5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c4c059035ab3f4ce8668daf6ccccb36537b86d8f0d83e719432467ca41d4e9960b37fac8548f04c3af10e356d9ea9febbaaf29c6d6cbdd0862a5adc138c4e6c', 'id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'created_at': datetime.datetime(2026, 11, 3, 11, 17, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 17, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f5af533-dfbd-492d-9f13-8420968a5390/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Trying to clone 0cb15a85-c733-409d-af44-f40d051e27b0 from image 5f5af533-dfbd-492d-9f13-8420968a5390 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:17:42 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Image download 0.00 MB at 0.00 MB/s Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[05010658-471d-430b-852a-b2f99b23fdaa]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:42 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:43 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:43 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:43 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw Nov 03 12:17:43 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:43 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw" returned: 1 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_15kgv9gw' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b58a71-de68-4d3d-8edf-3ff19d03e278]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:43 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:43 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:43 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:43 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD Nov 03 12:17:43 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:43 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:17:43 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Temporary image 5f5af533-dfbd-492d-9f13-8420968a5390 is fetched for user cab5d035bf6b4e80981669437518e27d. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:43 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 Nov 03 12:17:43 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b8bb1-5a7c-4910-b152-b9ffe6a6ffa4]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:43 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:43 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:44 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:44 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:44 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:44 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb15a85-c733-409d-af44-f40d051e27b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230cac22ba0d48ceae3909ff0ccaf5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:42Z,use_quota=True,user_id='cab5d035bf6b4e80981669437518e27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6b40f07-eb52-489e-b966-a475eaa760c4),volume_type_id=f6b40f07-eb52-489e-b966-a475eaa760c4)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Creating volume 0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:44 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:44 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1073741824 Nov 03 12:17:44 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:44 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1073741824" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:44 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 Nov 03 12:17:44 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:45 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0" returned: 0 in 0.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Attempting download of 5f5af533-dfbd-492d-9f13-8420968a5390 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}])) to volume 0cb15a85-c733-409d-af44-f40d051e27b0. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4fb758-ffb1-4b41-8a73-408040507407]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:45 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg Nov 03 12:17:45 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:45 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48" returned: 0 in 2.006s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_sm80nkccdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:17:45 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Converted 112.00 MB image at 55.79 MB/s Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:45 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1G Nov 03 12:17:45 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:45 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:45 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg Nov 03 12:17:45 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:45 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 1G" returned: 0 in 0.339s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Downloaded image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume d921f60e-eda2-424a-987e-2145aefe3c48 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 for user 0531d961eda1478d8fb4be9f13f2a3c9 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Marking volume d921f60e-eda2-424a-987e-2145aefe3c48 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Copying metadata from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 to d921f60e-eda2-424a-987e-2145aefe3c48. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:17:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Creating volume glance metadata for volume d921f60e-eda2-424a-987e-2145aefe3c48 backed by image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70143b9c-94d8-40c8-9b1e-2e741f0134a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d921f60e-eda2-424a-987e-2145aefe3c48', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d60be30-be27-4e22-ac89-a08d6d85b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Volume volume-d921f60e-eda2-424a-987e-2145aefe3c48 (d921f60e-eda2-424a-987e-2145aefe3c48): created successfully Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d60be30-be27-4e22-ac89-a08d6d85b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Flow 'volume_create_manager' (7f4ad703-92df-468d-b703-117200bd0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3b047d16-d110-4099-a00e-b656aa44d7d3 tempest-VolumesExtendTest-1531516385 None] Created volume successfully. Nov 03 12:17:46 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg" returned: 1 in 0.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f5af533-dfbd-492d-9f13-8420968a5390_oxn4yuvg' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb09498-3374-4f34-9b94-d8b49d69f513]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:46 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:46 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Flow 'volume_create_manager' (414db10c-268c-4e3d-b1b3-c6aef1578182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005bb796-a715-4f69-9e02-c8857937a65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005bb796-a715-4f69-9e02-c8857937a65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1108032236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d76a63-999a-497c-a163-f6d3c71e8b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146f4f208ad4f96b6b2bc8fe728b2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:46Z,use_quota=True,user_id='170de9c6b92d49f9ac1073e0ca65d11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7206db-ef87-4ab5-8789-11e640bfb831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7206db-ef87-4ab5-8789-11e640bfb831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d10612-bf56-4880-8228-06d9f62ef1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d10612-bf56-4880-8228-06d9f62ef1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d76a63-999a-497c-a163-f6d3c71e8b2b', 'volume_name': 'volume-88d76a63-999a-497c-a163-f6d3c71e8b2b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7967926-9206-4447-b86b-06d7ab3b7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7967926-9206-4447-b86b-06d7ab3b7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0986ca7-7a40-4407-8160-dc10ebf75d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Volume 88d76a63-999a-497c-a163-f6d3c71e8b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d76a63-999a-497c-a163-f6d3c71e8b2b', 'volume_size': 1} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1108032236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d76a63-999a-497c-a163-f6d3c71e8b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146f4f208ad4f96b6b2bc8fe728b2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:46Z,use_quota=True,user_id='170de9c6b92d49f9ac1073e0ca65d11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Creating volume 88d76a63-999a-497c-a163-f6d3c71e8b2b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:46 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b 1073741824 Nov 03 12:17:46 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:46 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:46 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD Nov 03 12:17:46 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:46 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b 1073741824" returned: 0 in 0.471s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:46 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] 5f5af533-dfbd-492d-9f13-8420968a5390 was raw, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:46 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 Nov 03 12:17:46 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:46 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b Nov 03 12:17:46 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:47 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.618s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0986ca7-7a40-4407-8160-dc10ebf75d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d76a63-999a-497c-a163-f6d3c71e8b2b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a63bd1-8979-44e3-8468-7b0924d1a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18b918-721d-47a4-a9a2-a1d53941d07a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Volume volume-88d76a63-999a-497c-a163-f6d3c71e8b2b (88d76a63-999a-497c-a163-f6d3c71e8b2b): created successfully Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a63bd1-8979-44e3-8468-7b0924d1a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Flow 'volume_create_manager' (414db10c-268c-4e3d-b1b3-c6aef1578182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e112810-d016-40c5-85dc-70fcd2b57aa0 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Created volume successfully. Nov 03 12:17:47 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 Nov 03 12:17:47 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:47 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0" returned: 0 in 0.490s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f5af533-dfbd-492d-9f13-8420968a5390_dl1nuhz6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:47 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1G Nov 03 12:17:47 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:47 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48" returned: 0 in 0.423s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:47 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 1G" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Downloaded image 5f5af533-dfbd-492d-9f13-8420968a5390 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}])) to volume 0cb15a85-c733-409d-af44-f40d051e27b0 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Temporary image 5f5af533-dfbd-492d-9f13-8420968a5390 for user cab5d035bf6b4e80981669437518e27d is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Marking volume 0cb15a85-c733-409d-af44-f40d051e27b0 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 2G" returned: 0 in 0.111s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.571s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Copying metadata from image 5f5af533-dfbd-492d-9f13-8420968a5390 to 0cb15a85-c733-409d-af44-f40d051e27b0. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Creating volume glance metadata for volume 0cb15a85-c733-409d-af44-f40d051e27b0 backed by image 5f5af533-dfbd-492d-9f13-8420968a5390 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '79b8591e0e1722fe39582407573e02b2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7fab0bbd-15e6-468d-830a-7b5ff5da3c1a tempest-VolumesExtendTest-1531516385 None] Extend volume completed successfully. Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afb2815-785b-4207-8930-8d0d32ef60d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb15a85-c733-409d-af44-f40d051e27b0', 'volume_size': 1, 'image_id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f5af533-dfbd-492d-9f13-8420968a5390', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79b8591e0e1722fe39582407573e02b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '230cac22ba0d48ceae3909ff0ccaf5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c4c059035ab3f4ce8668daf6ccccb36537b86d8f0d83e719432467ca41d4e9960b37fac8548f04c3af10e356d9ea9febbaaf29c6d6cbdd0862a5adc138c4e6c', 'id': '5f5af533-dfbd-492d-9f13-8420968a5390', 'created_at': datetime.datetime(2026, 11, 3, 11, 17, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 17, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f5af533-dfbd-492d-9f13-8420968a5390/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745a385-9199-435e-8b9c-b83dc10fefb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Volume volume-0cb15a85-c733-409d-af44-f40d051e27b0 (0cb15a85-c733-409d-af44-f40d051e27b0): created successfully Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745a385-9199-435e-8b9c-b83dc10fefb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Flow 'volume_create_manager' (e116bb39-fe36-4316-8358-89ae0f2d53a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8a4e9962-8c35-4c1e-aed5-6df4ca51f45a tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Created volume successfully. Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Acquiring lock "cinder-0cb15a85-c733-409d-af44-f40d051e27b0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "cinder-0cb15a85-c733-409d-af44-f40d051e27b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Acquiring lock "cinder-quobyte-0cb15a85-c733-409d-af44-f40d051e27b0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "cinder-quobyte-0cb15a85-c733-409d-af44-f40d051e27b0" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[68829575-5ca4-44de-ae92-96c82df914ce]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:49 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 Nov 03 12:17:49 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f7163196-04da-4981-a25a-a402856a966f req-ae56aa46-7a81-4145-9cb4-a6a2f9de553a tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f7163196-04da-4981-a25a-a402856a966f req-ae56aa46-7a81-4145-9cb4-a6a2f9de553a tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-d921f60e-eda2-424a-987e-2145aefe3c48-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f7163196-04da-4981-a25a-a402856a966f req-ae56aa46-7a81-4145-9cb4-a6a2f9de553a tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-d921f60e-eda2-424a-987e-2145aefe3c48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-f7163196-04da-4981-a25a-a402856a966f req-ae56aa46-7a81-4145-9cb4-a6a2f9de553a tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-88d76a63-999a-497c-a163-f6d3c71e8b2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9c71cef-35ca-4402-a813-eefc5fbeb83a', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-quobyte-d921f60e-eda2-424a-987e-2145aefe3c48" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-d921f60e-eda2-424a-987e-2145aefe3c48" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:49 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0" returned: 0 in 0.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfd4ad-83bb-4130-9f35-9f3a507ee25d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:49 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0 Nov 03 12:17:49 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f7163196-04da-4981-a25a-a402856a966f req-ae56aa46-7a81-4145-9cb4-a6a2f9de553a tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] attachment_update completed successfully. Nov 03 12:17:49 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 Nov 03 12:17:49 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:49 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-0cb15a85-c733-409d-af44-f40d051e27b0" returned: 0 in 0.331s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "cinder-quobyte-0cb15a85-c733-409d-af44-f40d051e27b0" released by "delete_volume" :: held 0.812s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:49 devstack cinder-volume[86561]: WARNING cinder.quota [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:17:49 devstack cinder-volume[86561]: WARNING cinder.quota [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Created reservations ['3c0cfe25-5f17-4ca5-bab9-6e47c80e0171', 'dc97228f-c725-4f71-a351-9cdc52eeb196', '88daaf1f-08a4-42f4-968c-bd1aca8cc8c9', 'd6ac2adf-0714-433d-a3f8-4d5b6486d433'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:49 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48" returned: 0 in 0.529s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:49 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48 Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:49 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:49 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:49 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:50 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d921f60e-eda2-424a-987e-2145aefe3c48" returned: 0 in 0.308s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-d921f60e-eda2-424a-987e-2145aefe3c48" released by "delete_volume" :: held 0.906s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:50 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Deleted volume successfully. Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7782cee4-0423-4a67-a4a1-a92b423fea39 tempest-VolumeAndVolumeTypeFromImageTest-892734181 None] Lock "cinder-0cb15a85-c733-409d-af44-f40d051e27b0-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Created reservations ['edad1d5b-0a49-4e23-88ea-c7bc4929c59e', '2068c8cd-ba04-4c15-b09f-21e84f298a0b', 'c9e1aa76-4902-4575-bbd1-e68790e3bdd8', 'a8a51a17-b18a-4f98-808c-3c2ee7f800cd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:50 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:50 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:50 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Deleted volume successfully. Nov 03 12:17:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee73d477-8b54-42c1-94ad-4eaa131f94f1 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-d921f60e-eda2-424a-987e-2145aefe3c48-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:51 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=88,cinder:INSERT=29,cinder:UPDATE=91,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:17:51 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=79,cinder:SELECT=82,cinder:DELETE=8,cinder:INSERT=28 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:17:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Flow 'volume_create_manager' (cf5e16db-7641-4b05-bb52-62d2e8eb2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5755446a-cffe-4d30-a6f1-fc6ece6eefb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5755446a-cffe-4d30-a6f1-fc6ece6eefb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-471892298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0126ad8-078a-4f43-9a7b-bc53c568a42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554f7704d41745018f78959746c89658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:52Z,use_quota=True,user_id='0531d961eda1478d8fb4be9f13f2a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6243d20-609b-4f1b-b8e3-d65250be45ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6243d20-609b-4f1b-b8e3-d65250be45ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b6bb70-4448-4469-8e09-56ddffba0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b6bb70-4448-4469-8e09-56ddffba0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0126ad8-078a-4f43-9a7b-bc53c568a42b', 'volume_name': 'volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea3e323-bd35-405f-80a1-7f3dba146cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea3e323-bd35-405f-80a1-7f3dba146cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8be79c-51fc-4a65-9c7e-c9aa3a20e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Volume c0126ad8-078a-4f43-9a7b-bc53c568a42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b', 'volume_size': 1} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-471892298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0126ad8-078a-4f43-9a7b-bc53c568a42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554f7704d41745018f78959746c89658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:52Z,use_quota=True,user_id='0531d961eda1478d8fb4be9f13f2a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Creating volume c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:52 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b 1073741824 Nov 03 12:17:52 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-cd9aceef-533e-481b-ac38-893632b01b18 req-654beceb-85c6-447a-af97-a6f3931d0a5d tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Terminate volume connection completed successfully. Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-cd9aceef-533e-481b-ac38-893632b01b18 req-654beceb-85c6-447a-af97-a6f3931d0a5d tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Deleting attachment d9c71cef-35ca-4402-a813-eefc5fbeb83a. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:17:52 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b 1073741824" returned: 0 in 0.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:52 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:17:52 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:53 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.267s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8be79c-51fc-4a65-9c7e-c9aa3a20e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba9a71-abd4-46ca-824b-e10aeb9b858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Volume volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b (c0126ad8-078a-4f43-9a7b-bc53c568a42b): created successfully Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba9a71-abd4-46ca-824b-e10aeb9b858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Flow 'volume_create_manager' (cf5e16db-7641-4b05-bb52-62d2e8eb2a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e4fa4122-eb57-466a-9f2a-598b76f7bb88 tempest-VolumesExtendTest-1531516385 None] Created volume successfully. Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "cinder-88d76a63-999a-497c-a163-f6d3c71e8b2b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "cinder-88d76a63-999a-497c-a163-f6d3c71e8b2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "cinder-quobyte-88d76a63-999a-497c-a163-f6d3c71e8b2b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "cinder-quobyte-88d76a63-999a-497c-a163-f6d3c71e8b2b" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710ce01-8a62-4627-b7e4-80e443778afc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:53 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b Nov 03 12:17:53 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:53 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b" returned: 0 in 0.391s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:53 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b Nov 03 12:17:53 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:54 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-88d76a63-999a-497c-a163-f6d3c71e8b2b" returned: 0 in 0.292s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "cinder-quobyte-88d76a63-999a-497c-a163-f6d3c71e8b2b" released by "delete_volume" :: held 0.738s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Creating offline snapshot dd4f2139-b766-4449-8fd1-c585d4db691e of volume c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd32db2-6d50-4136-a42a-fcef3574c0a1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Created reservations ['c8af853e-0f5f-4296-be1f-4a674752ed1d', '477df22c-5b5a-4b13-8a59-70038c6a4134', '894d2b3d-07db-4154-ac91-1e9565615f26', '0028705e-f081-42c1-8829-f00dfb722888'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:54 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:17:54 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:54 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:17:54 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:54 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:17:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Deleted volume successfully. Nov 03 12:17:54 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.459s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ddb5394c-a3df-496d-bacf-d6ef06288c82 tempest-TestServerVolumeAttachScenarioOldVersion-578210031 None] Lock "cinder-88d76a63-999a-497c-a163-f6d3c71e8b2b-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:17:54 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e 1G Nov 03 12:17:54 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Flow 'volume_create_manager' (56204c42-a371-4132-9518-8c08ed1ee393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc5b9d6-8618-4679-ab29-c81bad1d5a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc5b9d6-8618-4679-ab29-c81bad1d5a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b28a9-aa29-403b-ad80-6a8967d66702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3462ee43e7dd438c8148dc699a6a5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:55Z,use_quota=True,user_id='2e9b155a4b954690b676646be93a4f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3d4069-d69f-426c-80b1-451f35a6dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3d4069-d69f-426c-80b1-451f35a6dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a32899-6575-4de6-98ec-810134d98091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a32899-6575-4de6-98ec-810134d98091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5b28a9-aa29-403b-ad80-6a8967d66702', 'volume_name': 'volume-6e5b28a9-aa29-403b-ad80-6a8967d66702', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48de699e-771b-4c72-9f81-364ecee2547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48de699e-771b-4c72-9f81-364ecee2547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894d1874-8307-4f6d-89d9-032e145ccb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Volume 6e5b28a9-aa29-403b-ad80-6a8967d66702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5b28a9-aa29-403b-ad80-6a8967d66702', 'volume_size': 1} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:55 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e 1G" returned: 0 in 0.576s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:55 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e Nov 03 12:17:55 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:55 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e" returned: 0 in 0.336s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:55 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e is being set with open permissions: ugo+rw Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:55 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e Nov 03 12:17:55 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:55 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:55 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info Nov 03 12:17:55 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:56 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info" returned: 0 in 0.274s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:56 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info is being set with open permissions: ugo+rw Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:56 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info Nov 03 12:17:56 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:56 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.info" returned: 0 in 0.317s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b28a9-aa29-403b-ad80-6a8967d66702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3462ee43e7dd438c8148dc699a6a5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:55Z,use_quota=True,user_id='2e9b155a4b954690b676646be93a4f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Creating volume 6e5b28a9-aa29-403b-ad80-6a8967d66702 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:56 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 1073741824 Nov 03 12:17:56 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9b0944db-7e9e-4a5a-9fe2-6dad94c51748 tempest-VolumesExtendTest-1531516385 None] Create snapshot completed successfully Nov 03 12:17:57 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 1073741824" returned: 0 in 0.520s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:57 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 Nov 03 12:17:57 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:57 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702" returned: 0 in 0.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894d1874-8307-4f6d-89d9-032e145ccb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5b28a9-aa29-403b-ad80-6a8967d66702', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b86cb4-08bf-429c-ad39-8a16882e8291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Volume volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 (6e5b28a9-aa29-403b-ad80-6a8967d66702): created successfully Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b86cb4-08bf-429c-ad39-8a16882e8291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Flow 'volume_create_manager' (56204c42-a371-4132-9518-8c08ed1ee393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e2c7a2f2-83e4-4f73-b972-91c7b44741f7 tempest-CinderUnicodeTest-284213239 None] Created volume successfully. Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c119165-2078-4fba-81b4-dce8fdf52c69]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:57 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:17:57 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:57 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e 2G" returned: 0 in 0.173s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.613s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-14ee2330-57ad-4982-a1dc-5c7a3f6e1300 tempest-VolumesExtendTest-1531516385 None] Extend volume completed successfully. Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Flow 'volume_create_manager' (15cd0448-42fa-45a1-963b-e8e8319452c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad54496-a5c7-4a99-82b9-122f0016737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad54496-a5c7-4a99-82b9-122f0016737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1321015673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4028529c-1212-4609-8a48-cb100f687669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3462ee43e7dd438c8148dc699a6a5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:59Z,use_quota=True,user_id='2e9b155a4b954690b676646be93a4f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e062386f-8e14-4bef-9d05-ab04e701242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e062386f-8e14-4bef-9d05-ab04e701242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c578728e-7ce7-4701-80ed-2de44d86ea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c578728e-7ce7-4701-80ed-2de44d86ea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4028529c-1212-4609-8a48-cb100f687669', 'volume_name': 'volume-4028529c-1212-4609-8a48-cb100f687669', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415b9a9-b8ab-4cdd-9b80-bf0f7ceb22c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415b9a9-b8ab-4cdd-9b80-bf0f7ceb22c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fdc805-4ae0-4228-9c95-70f4e60a89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Volume 4028529c-1212-4609-8a48-cb100f687669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4028529c-1212-4609-8a48-cb100f687669', 'volume_size': 1} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:17:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1321015673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4028529c-1212-4609-8a48-cb100f687669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3462ee43e7dd438c8148dc699a6a5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:17:59Z,use_quota=True,user_id='2e9b155a4b954690b676646be93a4f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Creating volume 4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:17:58 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-dd4f2139-b766-4449-8fd1-c585d4db691e-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:58 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 1073741824 Nov 03 12:17:58 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-dd4f2139-b766-4449-8fd1-c585d4db691e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-quobyte-dd4f2139-b766-4449-8fd1-c585d4db691e" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-dd4f2139-b766-4449-8fd1-c585d4db691e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Deleting offline snapshot dd4f2139-b766-4449-8fd1-c585d4db691e of volume c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] snapshot_file for this snap is: volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[934eb250-29d1-46a6-95df-57fa989b1aa6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:59 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e Nov 03 12:17:59 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:59 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 1073741824" returned: 0 in 0.505s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:59 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e" returned: 0 in 0.415s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd4fb29-6bb9-42bc-9d01-62423478eff8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:59 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 Nov 03 12:17:59 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:59 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:17:59 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:17:59 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669" returned: 0 in 0.300s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fdc805-4ae0-4228-9c95-70f4e60a89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4028529c-1212-4609-8a48-cb100f687669', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31274a77-a704-4e88-9418-5352f2a9e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:17:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Volume volume-4028529c-1212-4609-8a48-cb100f687669 (4028529c-1212-4609-8a48-cb100f687669): created successfully Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31274a77-a704-4e88-9418-5352f2a9e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Flow 'volume_create_manager' (15cd0448-42fa-45a1-963b-e8e8319452c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:17:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0e2fa645-d611-43a3-bd56-15a7ba79e720 tempest-CinderUnicodeTest-284213239 None] Created volume successfully. Nov 03 12:17:59 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:17:59 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e Nov 03 12:17:59 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:00 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:00 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e Nov 03 12:18:00 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:00 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b.dd4f2139-b766-4449-8fd1-c585d4db691e" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-dd4f2139-b766-4449-8fd1-c585d4db691e" released by "_delete_snapshot" :: held 1.605s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" released by "delete_snapshot" :: held 1.628s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Created reservations ['4522f626-b0d5-4d2d-acbd-7fcebaf9e9cc', '6b6a7464-8b55-409e-b3cf-1bf0be8c3da0', 'bdb747bf-f0a4-4643-8be2-0dd96431dbd4', '814ebb7a-7639-44fd-a622-5dcbb34c811a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Delete snapshot completed successfully. Nov 03 12:18:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ee1acd50-b4e2-4ef1-a03d-177cebc76589 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-dd4f2139-b766-4449-8fd1-c585d4db691e-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-c0126ad8-078a-4f43-9a7b-bc53c568a42b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-c0126ad8-078a-4f43-9a7b-bc53c568a42b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Creating offline snapshot ca925241-0ef6-4940-8c53-5fd4858f0f0f of volume 4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac0c9df-d678-4855-abf5-8d5f8758a2b0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3db156-c2db-4e78-b205-69b2d0a104d6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:01 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 Nov 03 12:18:01 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:01 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:18:01 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:01 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:01 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f 1G Nov 03 12:18:01 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:01 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:01 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b Nov 03 12:18:01 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:01 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c0126ad8-078a-4f43-9a7b-bc53c568a42b" returned: 0 in 0.257s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-quobyte-c0126ad8-078a-4f43-9a7b-bc53c568a42b" released by "delete_volume" :: held 0.713s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Created reservations ['cfdeee4e-bcc0-451f-8cd0-5333b9eaa426', '01f74cb1-2e86-4b8d-99bc-897ec85af803', '44369801-e7f3-472d-b978-34cb274c3dfc', 'e62f9f47-496f-4a38-85c0-ed3150d5573e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:01 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f 1G" returned: 0 in 0.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4028529c-1212-4609-8a48-cb100f687669 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:02 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4028529c-1212-4609-8a48-cb100f687669 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f Nov 03 12:18:02 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:02 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:18:02 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:02 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:18:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Deleted volume successfully. Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd1616cf-1a59-4209-bc04-a1fbed49b611 tempest-VolumesExtendTest-1531516385 None] Lock "cinder-c0126ad8-078a-4f43-9a7b-bc53c568a42b-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:02 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4028529c-1212-4609-8a48-cb100f687669 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f" returned: 0 in 0.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:02 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f is being set with open permissions: ugo+rw Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:02 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f Nov 03 12:18:02 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:02 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f" returned: 0 in 0.257s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:02 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info Nov 03 12:18:02 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:02 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info is being set with open permissions: ugo+rw Nov 03 12:18:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:03 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info Nov 03 12:18:03 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:03 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.info" returned: 0 in 0.297s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-24d2666d-3122-4bd8-9a24-4e69c696d71e tempest-CinderUnicodeTest-284213239 None] Create snapshot completed successfully Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-ca925241-0ef6-4940-8c53-5fd4858f0f0f-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-ca925241-0ef6-4940-8c53-5fd4858f0f0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-quobyte-ca925241-0ef6-4940-8c53-5fd4858f0f0f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-ca925241-0ef6-4940-8c53-5fd4858f0f0f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Deleting offline snapshot ca925241-0ef6-4940-8c53-5fd4858f0f0f of volume 4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] snapshot_file for this snap is: volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc86e0df-b1c6-4205-99de-1e0bd8b8a5bc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:04 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f Nov 03 12:18:04 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:04 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f" returned: 0 in 0.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4028529c-1212-4609-8a48-cb100f687669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[67140e33-b272-4990-b1f0-40fb42e884a7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:04 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 Nov 03 12:18:04 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:05 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669" returned: 0 in 0.395s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:05 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f Nov 03 12:18:05 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:05 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f" returned: 0 in 0.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:05 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f Nov 03 12:18:05 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:05 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669.ca925241-0ef6-4940-8c53-5fd4858f0f0f" returned: 0 in 0.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-ca925241-0ef6-4940-8c53-5fd4858f0f0f" released by "_delete_snapshot" :: held 1.655s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" released by "delete_snapshot" :: held 1.680s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Created reservations ['381c009a-9cf4-4133-b89a-50e6c0d63ad4', '4f221c54-a7f4-453e-b6fb-35e85ae587b3', '9b922bef-e4e2-4dfa-9ab9-6675a1802d61', '7f26f0d8-00b5-4305-8d27-364e6e930d0a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Delete snapshot completed successfully. Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8c2a92da-dc13-409a-b1a5-6bb2a380947b tempest-CinderUnicodeTest-284213239 None] Lock "cinder-ca925241-0ef6-4940-8c53-5fd4858f0f0f-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Flow 'volume_create_manager' (3637847b-9c45-4284-bd92-22aeccf7f7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e443dff6-b519-4b36-b942-a3eeb58e441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e443dff6-b519-4b36-b942-a3eeb58e441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2079226152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682b83f9-13c4-473a-b699-a7f0c28f8d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9bc6555aa6467da6e9fa16dd40c556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:06Z,use_quota=True,user_id='6d9c79397f1e413d824c85b167e0fd3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b177666b-53fe-4fb2-b802-17df688e5749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b177666b-53fe-4fb2-b802-17df688e5749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fbfbea-6d35-4299-ae02-e5be6e92ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fbfbea-6d35-4299-ae02-e5be6e92ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682b83f9-13c4-473a-b699-a7f0c28f8d6e', 'volume_name': 'volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac162353-9cea-436e-a480-8550606726cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac162353-9cea-436e-a480-8550606726cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d799986-51cd-4add-a21f-0e3631335373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Volume 682b83f9-13c4-473a-b699-a7f0c28f8d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e', 'volume_size': 1} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2079226152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682b83f9-13c4-473a-b699-a7f0c28f8d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9bc6555aa6467da6e9fa16dd40c556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:06Z,use_quota=True,user_id='6d9c79397f1e413d824c85b167e0fd3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Creating volume 682b83f9-13c4-473a-b699-a7f0c28f8d6e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:18:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:06 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e 1073741824 Nov 03 12:18:06 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-4028529c-1212-4609-8a48-cb100f687669-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "cinder-4028529c-1212-4609-8a48-cb100f687669-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98572a-97fa-4424-8eb7-6513ae158e46]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:06 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 Nov 03 12:18:06 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:06 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e 1073741824" returned: 0 in 0.616s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:07 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e Nov 03 12:18:07 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:07 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669" returned: 0 in 0.508s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:07 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669 Nov 03 12:18:07 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:07 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e" returned: 0 in 0.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d799986-51cd-4add-a21f-0e3631335373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785ed423-95a1-4b9f-be8e-64769e533a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Volume volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e (682b83f9-13c4-473a-b699-a7f0c28f8d6e): created successfully Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785ed423-95a1-4b9f-be8e-64769e533a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:07 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Flow 'volume_create_manager' (3637847b-9c45-4284-bd92-22aeccf7f7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4028529c-1212-4609-8a48-cb100f687669" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8cfaec31-5105-4eae-aaed-aa71ee170115 tempest-VolumesNegativeTest-760162727 None] Created volume successfully. Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-4028529c-1212-4609-8a48-cb100f687669" released by "delete_volume" :: held 0.876s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Created reservations ['302c046c-673d-47c9-8dae-12b71d69b478', 'cd8e928b-60a4-4edf-8df7-2448a7879d52', 'accf094a-160d-4e61-90f4-05a8f156788a', 'c36dd219-da9f-44e9-b9d6-5091b4dbb52b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:07 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:18:07 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-6e5b28a9-aa29-403b-ad80-6a8967d66702-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "cinder-6e5b28a9-aa29-403b-ad80-6a8967d66702-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "cinder-quobyte-6e5b28a9-aa29-403b-ad80-6a8967d66702" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-6e5b28a9-aa29-403b-ad80-6a8967d66702" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa70a284-1b6e-4cad-82d6-abae1df5ae27]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:07 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.362s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:18:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Deleted volume successfully. Nov 03 12:18:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a2df597d-253d-400b-96b9-dfc79524948a tempest-CinderUnicodeTest-284213239 None] Lock "cinder-4028529c-1212-4609-8a48-cb100f687669-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:07 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 Nov 03 12:18:07 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:08 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:08 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702 Nov 03 12:18:08 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:08 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6e5b28a9-aa29-403b-ad80-6a8967d66702" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "cinder-quobyte-6e5b28a9-aa29-403b-ad80-6a8967d66702" released by "delete_volume" :: held 0.733s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Created reservations ['5c3a9eb0-67c7-40b2-a67a-af8d4dfe3374', 'cb66cc96-33cc-4c0b-9919-702357ac12d5', 'd54f798f-c694-4aae-ae53-48757d0ccab5', '41bc9eee-e2df-4a75-908a-33a6bf7c6a3c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:08 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:18:08 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:08 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.299s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:18:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Deleted volume successfully. Nov 03 12:18:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-add41ac2-f46c-4780-87e0-0c31b1a2e947 tempest-CinderUnicodeTest-284213239 None] Lock "cinder-6e5b28a9-aa29-403b-ad80-6a8967d66702-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:18 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=47,cinder:UPDATE=58,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:18:18 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=49,cinder:UPDATE=62,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:24 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:18:24 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:24 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Acquiring lock "cinder-682b83f9-13c4-473a-b699-a7f0c28f8d6e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "cinder-682b83f9-13c4-473a-b699-a7f0c28f8d6e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Acquiring lock "cinder-quobyte-682b83f9-13c4-473a-b699-a7f0c28f8d6e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "cinder-quobyte-682b83f9-13c4-473a-b699-a7f0c28f8d6e" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f4453c-2c9e-4572-91b5-7331f9ee9f16]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:28 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e Nov 03 12:18:28 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:28 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e" returned: 0 in 0.398s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:28 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e Nov 03 12:18:28 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:29 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-682b83f9-13c4-473a-b699-a7f0c28f8d6e" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "cinder-quobyte-682b83f9-13c4-473a-b699-a7f0c28f8d6e" released by "delete_volume" :: held 0.705s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Created reservations ['2dc9b30b-02a3-4fc5-84b5-a03a73144574', '184ca102-fec4-4fcc-88ea-1ff9e8d78bb6', '885b28af-6ca4-42bd-82b9-78446046c48b', '9433c75b-018f-4580-b090-a0cffbf1d0c0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:29 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:18:29 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:29 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.262s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:18:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Deleted volume successfully. Nov 03 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da787c40-a198-4ab5-acb5-fda3f344c61d tempest-VolumesNegativeTest-760162727 None] Lock "cinder-682b83f9-13c4-473a-b699-a7f0c28f8d6e-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Flow 'volume_create_manager' (10c001c9-7577-41ac-a16f-edf7dd8ad0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1190dc77-289f-4a47-b5c8-6d628f1d6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1190dc77-289f-4a47-b5c8-6d628f1d6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-412140273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d902f-cae4-4fbd-bb22-d527e95303af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e50e30d57c4e44b9abd671cdeea2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:38Z,use_quota=True,user_id='734a14799c294da7b996e6c13290c426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386e4b5f-f211-46ea-9473-ad258a1da07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386e4b5f-f211-46ea-9473-ad258a1da07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea7b6a-0b29-48f3-b210-66ade1875209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea7b6a-0b29-48f3-b210-66ade1875209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983d902f-cae4-4fbd-bb22-d527e95303af', 'volume_name': 'volume-983d902f-cae4-4fbd-bb22-d527e95303af', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8671eb53-d9a8-4660-89dd-f74096b89103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8671eb53-d9a8-4660-89dd-f74096b89103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1158a9a7-645d-4fb5-8970-a5eea4155d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:38 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Volume 983d902f-cae4-4fbd-bb22-d527e95303af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983d902f-cae4-4fbd-bb22-d527e95303af', 'volume_size': 1} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-412140273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d902f-cae4-4fbd-bb22-d527e95303af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e50e30d57c4e44b9abd671cdeea2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:38Z,use_quota=True,user_id='734a14799c294da7b996e6c13290c426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Creating volume 983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:18:38 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:18:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:38 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af 1073741824 Nov 03 12:18:38 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:39 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af 1073741824" returned: 0 in 0.523s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:39 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:18:39 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:39 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1158a9a7-645d-4fb5-8970-a5eea4155d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983d902f-cae4-4fbd-bb22-d527e95303af', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37071a00-715e-4288-bc06-c1ac6abdde83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Volume volume-983d902f-cae4-4fbd-bb22-d527e95303af (983d902f-cae4-4fbd-bb22-d527e95303af): created successfully Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37071a00-715e-4288-bc06-c1ac6abdde83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Flow 'volume_create_manager' (10c001c9-7577-41ac-a16f-edf7dd8ad0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d6624d47-fc07-4571-b5c6-bbd91baa4f6c tempest-TestImageHashVerification-2001192336 None] Created volume successfully. Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdcd89a-6ba2-4b8d-94f5-fc389421feca]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:41 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:18:41 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:41 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ff7cd-0d7c-4c04-96d0-ab64ea3d90e8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:41 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:18:41 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:42 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af /opt/stack/data/cinder/conversion/983d902f-cae4-4fbd-bb22-d527e95303af.temp_image.74cbef76-3988-4aaf-bff8-f311f4ab3afe3bey66_s.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:42 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af /opt/stack/data/cinder/conversion/983d902f-cae4-4fbd-bb22-d527e95303af.temp_image.74cbef76-3988-4aaf-bff8-f311f4ab3afe3bey66_s.img Nov 03 12:18:42 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af /opt/stack/data/cinder/conversion/983d902f-cae4-4fbd-bb22-d527e95303af.temp_image.74cbef76-3988-4aaf-bff8-f311f4ab3afe3bey66_s.img" returned: 0 in 6.772s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd7d1c0-c18b-4c0b-a15d-2e014e410c09]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:18:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:18:49 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:18:49 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:18:49 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:18:49 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 03 12:18:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.614s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:18:49 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/conversion/983d902f-cae4-4fbd-bb22-d527e95303af.temp_image.74cbef76-3988-4aaf-bff8-f311f4ab3afe3bey66_s.img {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:18:49 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Converted 1024.00 MB image at 151.19 MB/s Nov 03 12:18:49 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] 74cbef76-3988-4aaf-bff8-f311f4ab3afe was raw, no need to convert to raw {{(pid=86561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 12:18:51 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (3077cd5a-9dad-405c-873a-19bff00d4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5626b50-6244-4eeb-8e7f-ef79e425eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5626b50-6244-4eeb-8e7f-ef79e425eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1923952002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15404d51-9b85-4b27-963c-c6cca2731363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:57Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(873b4958-6143-453b-910f-fdf6db62a3ea),volume_type_id=873b4958-6143-453b-910f-fdf6db62a3ea)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b18e97-38f9-421b-9745-0bb9b8f58410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b18e97-38f9-421b-9745-0bb9b8f58410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814a87fe-0063-40ce-a336-14458c7a5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814a87fe-0063-40ce-a336-14458c7a5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15404d51-9b85-4b27-963c-c6cca2731363', 'volume_name': 'volume-15404d51-9b85-4b27-963c-c6cca2731363', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f74590-affd-48e4-8d47-124bf9cb293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f74590-affd-48e4-8d47-124bf9cb293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4e48b8-4e71-42c0-84d6-75f3896c097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume 15404d51-9b85-4b27-963c-c6cca2731363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15404d51-9b85-4b27-963c-c6cca2731363', 'volume_size': 1} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (97bb678a-a16c-486c-b9ea-b7ff6974b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e701c44a-689f-47cf-a44b-8af002ccbe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e701c44a-689f-47cf-a44b-8af002ccbe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2122880712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:57Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef5297e8-579b-45fc-a128-6176ed1c4a1f),volume_type_id=ef5297e8-579b-45fc-a128-6176ed1c4a1f)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d684267-ab38-4f5d-86a7-b1751cd2a95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d684267-ab38-4f5d-86a7-b1751cd2a95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93ed55-d166-4dea-8782-037f7b2c671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93ed55-d166-4dea-8782-037f7b2c671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38', 'volume_name': 'volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64659df9-5bd4-47f8-a69a-9ad946e96099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64659df9-5bd4-47f8-a69a-9ad946e96099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a2482-7ddd-43ac-8886-1638267306d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38', 'volume_size': 1} Nov 03 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (4ef950bc-f7db-43a8-b7a5-8d6e9bd041a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2539ac86-26cf-4a1b-8ea9-6528395830b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2539ac86-26cf-4a1b-8ea9-6528395830b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-259819075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fecea3-89f5-485c-8dae-0d1872cfa440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:58Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a213a5b0-c96d-4293-97ac-8d896318933f),volume_type_id=a213a5b0-c96d-4293-97ac-8d896318933f)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1459401d-bd16-4a7c-97a7-819c49b5e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1459401d-bd16-4a7c-97a7-819c49b5e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62fba6e-934e-4be5-a237-4f170d452477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62fba6e-934e-4be5-a237-4f170d452477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2fecea3-89f5-485c-8dae-0d1872cfa440', 'volume_name': 'volume-d2fecea3-89f5-485c-8dae-0d1872cfa440', 'volume_size': 1, 'image_id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--555297375', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7c0ae1248094af99c23217281590161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'created_at': datetime.datetime(2026, 11, 3, 11, 18, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978a6827-6f4a-4d6f-a14c-a47d881027ad/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659dc920-c944-475a-a87a-536ce44c9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659dc920-c944-475a-a87a-536ce44c9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4d0352-21c1-4be2-a495-cb6d75f5e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:18:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume d2fecea3-89f5-485c-8dae-0d1872cfa440: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2fecea3-89f5-485c-8dae-0d1872cfa440', 'volume_size': 1, 'image_id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--555297375', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7c0ae1248094af99c23217281590161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'created_at': datetime.datetime(2026, 11, 3, 11, 18, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978a6827-6f4a-4d6f-a14c-a47d881027ad/file', 'properties': {}}, 'image_service': } Nov 03 12:18:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Trying to clone d2fecea3-89f5-485c-8dae-0d1872cfa440 from image 978a6827-6f4a-4d6f-a14c-a47d881027ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:19:02 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD, size 20.69 MB, duration 3.85 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:19:02 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Image download 20.69 MB at 5.37 MB/s Nov 03 12:19:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd9d607-42bf-44c0-b129-3a5d818db577]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:02 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD Nov 03 12:19:02 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:02 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:02 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Temporary image 978a6827-6f4a-4d6f-a14c-a47d881027ad is fetched for user 29e9a8dd2a1845a797fa62fc4ebd9c62. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:19:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[33649d25-8714-44ca-9897-3472107aca33]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:03 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD Nov 03 12:19:03 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:03 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:08 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.250s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Uploaded volume to glance image-id: 74cbef76-3988-4aaf-bff8-f311f4ab3afe. {{(pid=86561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.437s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1923952002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15404d51-9b85-4b27-963c-c6cca2731363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:57Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(873b4958-6143-453b-910f-fdf6db62a3ea),volume_type_id=873b4958-6143-453b-910f-fdf6db62a3ea)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Creating volume 15404d51-9b85-4b27-963c-c6cca2731363 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:19:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:09 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 1073741824 Nov 03 12:19:09 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8f6d2225-911c-412d-a1bc-5eb98f45aeeb tempest-TestImageHashVerification-2001192336 None] Copy volume to image completed successfully. Nov 03 12:19:09 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 1073741824" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:10 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 Nov 03 12:19:10 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:10 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.742s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2122880712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:57Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef5297e8-579b-45fc-a128-6176ed1c4a1f),volume_type_id=ef5297e8-579b-45fc-a128-6176ed1c4a1f)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Creating volume ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:19:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4e48b8-4e71-42c0-84d6-75f3896c097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15404d51-9b85-4b27-963c-c6cca2731363', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:10 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 1073741824 Nov 03 12:19:10 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb4b016-134b-4b35-a214-9ba620a74a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume volume-15404d51-9b85-4b27-963c-c6cca2731363 (15404d51-9b85-4b27-963c-c6cca2731363): created successfully Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb4b016-134b-4b35-a214-9ba620a74a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (3077cd5a-9dad-405c-873a-19bff00d4a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-77190034-dcf6-4600-9e03-a4ed4fe5510c tempest-TestInstancesWithCinderVolumes-2024383245 None] Created volume successfully. Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Acquiring lock "cinder-983d902f-cae4-4fbd-bb22-d527e95303af-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "cinder-983d902f-cae4-4fbd-bb22-d527e95303af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Acquiring lock "cinder-quobyte-983d902f-cae4-4fbd-bb22-d527e95303af" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "cinder-quobyte-983d902f-cae4-4fbd-bb22-d527e95303af" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[79327fd8-ac59-403e-af71-3281608e8c65]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:10 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 1073741824" returned: 0 in 0.481s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:10 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:19:10 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:10 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 Nov 03 12:19:10 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:11 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:11 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.617s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-259819075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fecea3-89f5-485c-8dae-0d1872cfa440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c0ae1248094af99c23217281590161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:18:58Z,use_quota=True,user_id='29e9a8dd2a1845a797fa62fc4ebd9c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a213a5b0-c96d-4293-97ac-8d896318933f),volume_type_id=a213a5b0-c96d-4293-97ac-8d896318933f)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Creating volume d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:11 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af Nov 03 12:19:11 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:19:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a2482-7ddd-43ac-8886-1638267306d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:11 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1073741824 Nov 03 12:19:11 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc032ea5-406e-4bd9-a8d3-f3ac92d45130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 (ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38): created successfully Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc032ea5-406e-4bd9-a8d3-f3ac92d45130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (97bb678a-a16c-486c-b9ea-b7ff6974b732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6b79814d-5f5a-4261-a95a-cf5fcd0e2e38 tempest-TestInstancesWithCinderVolumes-2024383245 None] Created volume successfully. Nov 03 12:19:11 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-983d902f-cae4-4fbd-bb22-d527e95303af" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "cinder-quobyte-983d902f-cae4-4fbd-bb22-d527e95303af" released by "delete_volume" :: held 0.685s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Created reservations ['a15ae9ea-b786-4506-9ccf-ab694721ab30', 'b7ffa648-f479-4444-b93b-52402b0b56a5', 'a9abb670-2982-4c72-8eef-d7cf580c9653', 'eaf35af8-edb2-4426-aed0-c856f615fd9a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:11 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:19:11 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:11 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1073741824" returned: 0 in 0.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:11 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 Nov 03 12:19:11 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:11 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:19:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Deleted volume successfully. Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-09fe7019-e349-4b0e-b47e-1ec402aa024d tempest-TestImageHashVerification-2001192336 None] Lock "cinder-983d902f-cae4-4fbd-bb22-d527e95303af-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:19:11 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440" returned: 0 in 0.269s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Attempting download of 978a6827-6f4a-4d6f-a14c-a47d881027ad ((None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}])) to volume d2fecea3-89f5-485c-8dae-0d1872cfa440. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c663e518-3055-4004-8dda-d3ecd5a897cf]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:11 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx Nov 03 12:19:11 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:12 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:12 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx Nov 03 12:19:12 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:12 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx" returned: 1 in 0.339s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978a6827-6f4a-4d6f-a14c-a47d881027ad__4jokdhx' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42d4bc-fc81-4dcf-b3f4-5ecec33fe226]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:12 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD Nov 03 12:19:12 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:12 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] 978a6827-6f4a-4d6f-a14c-a47d881027ad was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:19:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:12 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 Nov 03 12:19:12 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:14 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440" returned: 0 in 1.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:14 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_978a6827-6f4a-4d6f-a14c-a47d881027ad_zuy50n2_devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:19:14 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Converted 112.00 MB image at 60.40 MB/s Nov 03 12:19:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:14 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1G Nov 03 12:19:14 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:15 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 1G" returned: 0 in 0.383s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Downloaded image 978a6827-6f4a-4d6f-a14c-a47d881027ad ((None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}])) to volume d2fecea3-89f5-485c-8dae-0d1872cfa440 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Temporary image 978a6827-6f4a-4d6f-a14c-a47d881027ad for user 29e9a8dd2a1845a797fa62fc4ebd9c62 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Marking volume d2fecea3-89f5-485c-8dae-0d1872cfa440 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Copying metadata from image 978a6827-6f4a-4d6f-a14c-a47d881027ad to d2fecea3-89f5-485c-8dae-0d1872cfa440. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Creating volume glance metadata for volume d2fecea3-89f5-485c-8dae-0d1872cfa440 backed by image 978a6827-6f4a-4d6f-a14c-a47d881027ad with: {'image_id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'image_name': 'tempest-scenario-img--555297375', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4d0352-21c1-4be2-a495-cb6d75f5e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fecea3-89f5-485c-8dae-0d1872cfa440', 'volume_size': 1, 'image_id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978a6827-6f4a-4d6f-a14c-a47d881027ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--555297375', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7c0ae1248094af99c23217281590161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '978a6827-6f4a-4d6f-a14c-a47d881027ad', 'created_at': datetime.datetime(2026, 11, 3, 11, 18, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978a6827-6f4a-4d6f-a14c-a47d881027ad/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f5c11e-69c1-435e-b20d-789948d69d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Volume volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 (d2fecea3-89f5-485c-8dae-0d1872cfa440): created successfully Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f5c11e-69c1-435e-b20d-789948d69d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Flow 'volume_create_manager' (4ef950bc-f7db-43a8-b7a5-8d6e9bd041a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-325d9fad-83db-4fa2-bb90-d8d405a2c0f7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Created volume successfully. Nov 03 12:19:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8f401b44-de50-4c1f-ad51-445e671236b7 req-e13e2412-8e1c-4a56-99c2-cc88a9db72dd tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8f401b44-de50-4c1f-ad51-445e671236b7 req-e13e2412-8e1c-4a56-99c2-cc88a9db72dd tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8f401b44-de50-4c1f-ad51-445e671236b7 req-e13e2412-8e1c-4a56-99c2-cc88a9db72dd tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-8f401b44-de50-4c1f-ad51-445e671236b7 req-e13e2412-8e1c-4a56-99c2-cc88a9db72dd tempest-TestInstancesWithCinderVolumes-2024383245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-d2fecea3-89f5-485c-8dae-0d1872cfa440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd76dc977-28f5-4378-8e8d-f7f816078f01', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:19:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-8f401b44-de50-4c1f-ad51-445e671236b7 req-e13e2412-8e1c-4a56-99c2-cc88a9db72dd tempest-TestInstancesWithCinderVolumes-2024383245 None] attachment_update completed successfully. Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:24 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:19:24 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:24 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.276s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:19:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:19:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=21,cinder:UPDATE=18,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:19:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:19:42 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Flow 'volume_create_manager' (00662ef7-306e-49eb-b500-a4f09ecffb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a4027-17e9-4d40-80b6-3dc97f63c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a4027-17e9-4d40-80b6-3dc97f63c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1046981702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c931df1-0560-497b-a5f0-7b6ffad42023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c00b467ce1f4099a1b3d3b0107d6c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:19:50Z,use_quota=True,user_id='45941a0d12054c87a3c3acaf5174c9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9494af7d-d5f1-4849-87da-ef766ac13157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9494af7d-d5f1-4849-87da-ef766ac13157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2935fd-4add-48eb-bdb2-d62940f02620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2935fd-4add-48eb-bdb2-d62940f02620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c931df1-0560-497b-a5f0-7b6ffad42023', 'volume_name': 'volume-3c931df1-0560-497b-a5f0-7b6ffad42023', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4d67f1-0eea-43b5-829c-1f97c450cd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4d67f1-0eea-43b5-829c-1f97c450cd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b8fb64-6e8c-42ea-9c36-d592f17b7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Volume 3c931df1-0560-497b-a5f0-7b6ffad42023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c931df1-0560-497b-a5f0-7b6ffad42023', 'volume_size': 1} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1046981702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c931df1-0560-497b-a5f0-7b6ffad42023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c00b467ce1f4099a1b3d3b0107d6c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:19:50Z,use_quota=True,user_id='45941a0d12054c87a3c3acaf5174c9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Creating volume 3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:19:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:50 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 1073741824 Nov 03 12:19:50 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:50 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 1073741824" returned: 0 in 0.403s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:50 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:19:50 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:51 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b8fb64-6e8c-42ea-9c36-d592f17b7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c931df1-0560-497b-a5f0-7b6ffad42023', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3366e310-57d2-4e40-87b2-716190a57e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Volume volume-3c931df1-0560-497b-a5f0-7b6ffad42023 (3c931df1-0560-497b-a5f0-7b6ffad42023): created successfully Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3366e310-57d2-4e40-87b2-716190a57e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Flow 'volume_create_manager' (00662ef7-306e-49eb-b500-a4f09ecffb3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8ee51ca6-1301-4fca-b012-a1dca65db703 tempest-SnapshotDependencyTests-1575453827 None] Created volume successfully. Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Creating offline snapshot 4d6b39de-1247-4402-8b79-3417ce94204e of volume 3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3246633-bb97-47c0-a577-ae27f52e2f3d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:51 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:19:51 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:52 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:52 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e 1G Nov 03 12:19:52 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:52 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e 1G" returned: 0 in 0.457s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c931df1-0560-497b-a5f0-7b6ffad42023 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:52 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c931df1-0560-497b-a5f0-7b6ffad42023 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:19:52 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-047e65de-a8c7-4b3c-afe3-82d43af8fc40 req-61ed08a0-ff5f-405e-af10-5eca703ee90d tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:52 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c931df1-0560-497b-a5f0-7b6ffad42023 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.286s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:52 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e is being set with open permissions: ugo+rw Nov 03 12:19:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:52 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:19:52 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:53 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:53 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info Nov 03 12:19:53 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:53 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:53 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info is being set with open permissions: ugo+rw Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:53 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info Nov 03 12:19:53 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:53 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.info" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-047e65de-a8c7-4b3c-afe3-82d43af8fc40 req-61ed08a0-ff5f-405e-af10-5eca703ee90d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.042s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-047e65de-a8c7-4b3c-afe3-82d43af8fc40 req-61ed08a0-ff5f-405e-af10-5eca703ee90d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1a4b6130-d722-4519-9cd5-f34cf0909c57 tempest-SnapshotDependencyTests-1575453827 None] Create snapshot completed successfully Nov 03 12:19:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-047e65de-a8c7-4b3c-afe3-82d43af8fc40 req-61ed08a0-ff5f-405e-af10-5eca703ee90d tempest-TestInstancesWithCinderVolumes-2024383245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-15404d51-9b85-4b27-963c-c6cca2731363', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85deb963-db84-4f3a-ad1a-a96245cdc8d5', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:19:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-047e65de-a8c7-4b3c-afe3-82d43af8fc40 req-61ed08a0-ff5f-405e-af10-5eca703ee90d tempest-TestInstancesWithCinderVolumes-2024383245 None] attachment_update completed successfully. Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Flow 'volume_create_manager' (985352a1-ecfa-4779-8f8d-37d691d022d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580ce70-60b1-4ef3-84ee-7578faa5de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580ce70-60b1-4ef3-84ee-7578faa5de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49f393e-e4a7-46c9-8b1f-3f2be466dea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c00b467ce1f4099a1b3d3b0107d6c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d6b39de-1247-4402-8b79-3417ce94204e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:19:54Z,use_quota=True,user_id='45941a0d12054c87a3c3acaf5174c9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a01386-384d-46df-8872-55fe8409861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a01386-384d-46df-8872-55fe8409861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7565cae-0d00-4ebc-a65e-8a9d454b9cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7565cae-0d00-4ebc-a65e-8a9d454b9cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd49f393e-e4a7-46c9-8b1f-3f2be466dea8', 'volume_name': 'volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8', 'volume_size': 1, 'snapshot_id': '4d6b39de-1247-4402-8b79-3417ce94204e'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39f1bf-c9c8-4120-beb3-b0098d0ac938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39f1bf-c9c8-4120-beb3-b0098d0ac938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5c428-e149-45d2-aa4e-82013296947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:19:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Volume d49f393e-e4a7-46c9-8b1f-3f2be466dea8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8', 'volume_size': 1, 'snapshot_id': '4d6b39de-1247-4402-8b79-3417ce94204e'} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Creating volume d49f393e-e4a7-46c9-8b1f-3f2be466dea8 from snapshot 4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] snapshot: 4d6b39de-1247-4402-8b79-3417ce94204e, volume: d49f393e-e4a7-46c9-8b1f-3f2be466dea8, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[765e8161-b5f6-4ef2-a809-373896783a5e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:54 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:19:54 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:55 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c931df1-0560-497b-a5f0-7b6ffad42023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900dacb-45eb-4a65-935a-9f96d8679789]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:55 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:19:55 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:55 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.399s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:19:55 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 Nov 03 12:19:55 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:19:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d2fd415f-0dc5-48fe-9c14-5ee2a73cef00 req-b40d7628-7548-4c7c-bd3f-f141d0883d06 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:01 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" returned: 0 in 5.995s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:20:01 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Converted 1024.00 MB image at 170.78 MB/s Nov 03 12:20:01 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 is being set with open permissions: ugo+rw Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:01 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 Nov 03 12:20:01 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:01 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" released by "_copy_volume_from_snapshot" :: held 7.114s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" released by "_create_volume_from_snapshot" :: held 7.173s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.189s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d2fd415f-0dc5-48fe-9c14-5ee2a73cef00 req-b40d7628-7548-4c7c-bd3f-f141d0883d06 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.254s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d2fd415f-0dc5-48fe-9c14-5ee2a73cef00 req-b40d7628-7548-4c7c-bd3f-f141d0883d06 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5c428-e149-45d2-aa4e-82013296947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8', 'volume_size': 1, 'snapshot_id': '4d6b39de-1247-4402-8b79-3417ce94204e'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173e0e72-b88a-469d-b458-0866098be44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Volume volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 (d49f393e-e4a7-46c9-8b1f-3f2be466dea8): created successfully Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173e0e72-b88a-469d-b458-0866098be44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Flow 'volume_create_manager' (985352a1-ecfa-4779-8f8d-37d691d022d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:20:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-d2fd415f-0dc5-48fe-9c14-5ee2a73cef00 req-b40d7628-7548-4c7c-bd3f-f141d0883d06 tempest-TestInstancesWithCinderVolumes-2024383245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdb9ae87-0e39-42a7-b47d-0d31a66a8362', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:20:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-056bd2ad-ca52-4a3f-9c09-beeecc66d2b4 tempest-SnapshotDependencyTests-1575453827 None] Created volume successfully. Nov 03 12:20:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-d2fd415f-0dc5-48fe-9c14-5ee2a73cef00 req-b40d7628-7548-4c7c-bd3f-f141d0883d06 tempest-TestInstancesWithCinderVolumes-2024383245 None] attachment_update completed successfully. Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-4d6b39de-1247-4402-8b79-3417ce94204e-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-4d6b39de-1247-4402-8b79-3417ce94204e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Deleting offline snapshot 4d6b39de-1247-4402-8b79-3417ce94204e of volume 3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] snapshot_file for this snap is: volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd8ffe-498e-44db-8e55-044d06542d48]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:02 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:20:02 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:02 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.471s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c931df1-0560-497b-a5f0-7b6ffad42023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5160f806-d98c-40af-9f6d-7a01a44ffa99]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:02 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:20:02 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:03 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.547s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:03 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:20:03 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:03 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.383s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:03 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e Nov 03 12:20:03 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:03 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023.4d6b39de-1247-4402-8b79-3417ce94204e" returned: 0 in 0.272s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-4d6b39de-1247-4402-8b79-3417ce94204e" released by "_delete_snapshot" :: held 1.807s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" released by "delete_snapshot" :: held 1.840s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Created reservations ['034eebbe-c6f1-4b27-828d-4efda3e9f02f', '17b4939a-6759-489f-867e-a9d24cf803f6', '786b62aa-8ee2-46de-950f-797b97f421e1', '6ce695e4-6982-498d-a632-87f6113b9548'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Delete snapshot completed successfully. Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d26b945-b17f-4b57-8453-2d258a08c109 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-4d6b39de-1247-4402-8b79-3417ce94204e-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-3c931df1-0560-497b-a5f0-7b6ffad42023-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-3c931df1-0560-497b-a5f0-7b6ffad42023-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[513a6b26-3f84-4906-bd74-f34154ccfefe]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:04 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:20:04 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:04 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:04 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023 Nov 03 12:20:04 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:05 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3c931df1-0560-497b-a5f0-7b6ffad42023" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-3c931df1-0560-497b-a5f0-7b6ffad42023" released by "delete_volume" :: held 0.701s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Created reservations ['8615c2fc-fa4d-4acc-b7ce-9bd516991ce1', 'd56f68ae-4798-40ec-aaac-93def2feda3a', '4cf5fd63-d988-4f17-8781-b7678019acae', 'da032e06-42e7-486b-b19d-ac76a19ec470'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:05 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:05 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-d49f393e-e4a7-46c9-8b1f-3f2be466dea8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-d49f393e-e4a7-46c9-8b1f-3f2be466dea8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:05 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.281s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Deleted volume successfully. Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e017d-ccfb-4afd-b9c7-4088351d13a6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ba37663-0033-491b-9a70-8b6cc680aa88 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-3c931df1-0560-497b-a5f0-7b6ffad42023-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:05 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 Nov 03 12:20:05 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:06 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" returned: 0 in 0.355s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:06 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8 Nov 03 12:20:06 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:06 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-quobyte-d49f393e-e4a7-46c9-8b1f-3f2be466dea8" released by "delete_volume" :: held 0.659s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Created reservations ['b217bc4e-f01d-4462-b6a2-1dc17db82486', '77b9cbc5-97aa-4d75-8b72-4bf6423f907a', '0c98d9f9-9189-44e3-be31-b639aca78cd9', 'fbb92502-d3e2-43d1-9d79-bf912187de1e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:06 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:06 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:06 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.267s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Deleted volume successfully. Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5e65fb1c-85fc-4f19-a89d-a32457a1c8e4 tempest-SnapshotDependencyTests-1575453827 None] Lock "cinder-d49f393e-e4a7-46c9-8b1f-3f2be466dea8-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-38d34d5f-6a83-4dc6-a064-0fe5cd2d1fa6 req-8df06dc1-c165-4b69-91ca-8aac3f69b2bf tempest-TestInstancesWithCinderVolumes-2024383245 None] Terminate volume connection completed successfully. Nov 03 12:20:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-38d34d5f-6a83-4dc6-a064-0fe5cd2d1fa6 req-8df06dc1-c165-4b69-91ca-8aac3f69b2bf tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleting attachment 85deb963-db84-4f3a-ad1a-a96245cdc8d5. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-15404d51-9b85-4b27-963c-c6cca2731363-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-15404d51-9b85-4b27-963c-c6cca2731363-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-quobyte-15404d51-9b85-4b27-963c-c6cca2731363" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-15404d51-9b85-4b27-963c-c6cca2731363" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a55e3-3e62-4dad-97f1-4714677545d4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:08 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 Nov 03 12:20:08 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:08 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:08 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363 Nov 03 12:20:08 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:08 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-15404d51-9b85-4b27-963c-c6cca2731363" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-15404d51-9b85-4b27-963c-c6cca2731363" released by "delete_volume" :: held 0.754s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:08 devstack cinder-volume[86561]: WARNING cinder.quota [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766583072-884665555 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766583072-884665555, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:08 devstack cinder-volume[86561]: WARNING cinder.quota [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766583072-884665555 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766583072-884665555, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Created reservations ['b137fde6-39a0-4e94-8555-a803a624b821', '686f8637-cf38-49f9-80d8-712b41429b43', '54a670bc-3f76-4319-8b21-1eb191947e60', '175f76ae-5f97-43aa-bd81-153517842ff6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:08 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:08 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:09 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleted volume successfully. Nov 03 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2f99a4d0-6d36-4f74-ae29-e795567e804d tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-15404d51-9b85-4b27-963c-c6cca2731363-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-461ed5c7-53b7-42c0-9401-0c0050bef815 req-e4a44430-2e8f-4daf-85e6-9ab620100a8c tempest-TestInstancesWithCinderVolumes-2024383245 None] Terminate volume connection completed successfully. Nov 03 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-461ed5c7-53b7-42c0-9401-0c0050bef815 req-e4a44430-2e8f-4daf-85e6-9ab620100a8c tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleting attachment cdb9ae87-0e39-42a7-b47d-0d31a66a8362. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-quobyte-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" acquired by "delete_volume" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6c4e62-152d-4016-b0b2-7fd4d78d97c9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:12 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 Nov 03 12:20:12 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:12 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:12 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38 Nov 03 12:20:12 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:13 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38" released by "delete_volume" :: held 0.727s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:13 devstack cinder-volume[86561]: WARNING cinder.quota [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1653028834-348885630 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1653028834-348885630, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:13 devstack cinder-volume[86561]: WARNING cinder.quota [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1653028834-348885630 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1653028834-348885630, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Created reservations ['f82740a5-ebfb-4d88-b3a2-47a34642bd4e', '1abb03e6-93e7-4d8b-90cc-6680bbf4b832', '522bba6d-f05e-4f30-a290-37caf9d1b275', '924432ac-d9e3-46bd-bc44-57e412b5f9bb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:13 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:13 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:13 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.336s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleted volume successfully. Nov 03 12:20:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4bd5634d-9bcd-4dd1-8750-c985f11188d7 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-ff0c3e21-5ae5-4735-8b0d-cc5b33b14c38-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-25880f70-6b2c-4ac3-8e54-fda1cf91a9f0 req-92d6c345-1197-4c73-acc5-c83e66316ed4 tempest-TestInstancesWithCinderVolumes-2024383245 None] Terminate volume connection completed successfully. Nov 03 12:20:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-25880f70-6b2c-4ac3-8e54-fda1cf91a9f0 req-92d6c345-1197-4c73-acc5-c83e66316ed4 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleting attachment d76dc977-28f5-4378-8e8d-f7f816078f01. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-d2fecea3-89f5-485c-8dae-0d1872cfa440-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-d2fecea3-89f5-485c-8dae-0d1872cfa440-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "cinder-quobyte-d2fecea3-89f5-485c-8dae-0d1872cfa440" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-d2fecea3-89f5-485c-8dae-0d1872cfa440" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e24e487-4666-4c71-9f1f-6a774481ae5d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:18 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 Nov 03 12:20:18 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:18 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:18 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440 Nov 03 12:20:18 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:18 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-d2fecea3-89f5-485c-8dae-0d1872cfa440" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-quobyte-d2fecea3-89f5-485c-8dae-0d1872cfa440" released by "delete_volume" :: held 0.666s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897538283-986828667 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897538283-986828667, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897538283-986828667 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897538283-986828667, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Created reservations ['165fd8b7-2630-4690-b739-f19de3e9beac', '65a17dd3-acb6-4194-8622-e7ec079f5cbf', '4de5ca55-eb41-4411-94e1-5770e5894e5e', '60c3ae97-322c-4e17-afe1-850791c32e0d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:18 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:18 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:18 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Deleted volume successfully. Nov 03 12:20:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d38bf454-9991-429a-9c47-d59e306f9f14 tempest-TestInstancesWithCinderVolumes-2024383245 None] Lock "cinder-d2fecea3-89f5-485c-8dae-0d1872cfa440-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:24 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:20:24 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:24 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:20:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=58,cinder:UPDATE=53,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:20:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=53,cinder:INSERT=16,cinder:UPDATE=59,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Flow 'volume_create_manager' (0ad201c6-880d-46fd-ae41-71ee9dbf2a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1916344-6347-456d-89e5-352bc4bc064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1916344-6347-456d-89e5-352bc4bc064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-798242256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365bd300-d032-4c47-8265-a4b3a1d9f0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a3a002f404b8d8e19771cc02f8ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:20:52Z,use_quota=True,user_id='e29ededffd274a4d87726060df0830d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fabdb6-91bc-40ac-ab19-93fccedf816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fabdb6-91bc-40ac-ab19-93fccedf816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67072c5-55e9-40a7-881e-fa4f88b7aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67072c5-55e9-40a7-881e-fa4f88b7aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '365bd300-d032-4c47-8265-a4b3a1d9f0df', 'volume_name': 'volume-365bd300-d032-4c47-8265-a4b3a1d9f0df', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399840a-05ed-4585-bc0c-26f933de7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399840a-05ed-4585-bc0c-26f933de7793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f983e-6412-455d-a711-5753248b5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Volume 365bd300-d032-4c47-8265-a4b3a1d9f0df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-365bd300-d032-4c47-8265-a4b3a1d9f0df', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Trying to clone 365bd300-d032-4c47-8265-a4b3a1d9f0df from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:20:52 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[024849c7-2f52-4afb-9b36-fce00fe960ca]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:52 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD Nov 03 12:20:52 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:52 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 is fetched for user e29ededffd274a4d87726060df0830d9. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11c031-777a-4444-aca2-dbc3f921b1f5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:53 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD Nov 03 12:20:53 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:53 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-798242256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365bd300-d032-4c47-8265-a4b3a1d9f0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a3a002f404b8d8e19771cc02f8ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:20:52Z,use_quota=True,user_id='e29ededffd274a4d87726060df0830d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Creating volume 365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:20:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:53 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1073741824 Nov 03 12:20:53 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:53 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1073741824" returned: 0 in 0.427s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:53 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df Nov 03 12:20:53 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:54 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df" returned: 0 in 0.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Attempting download of c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 365bd300-d032-4c47-8265-a4b3a1d9f0df. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c348417c-dd32-4a53-b203-c038636de104]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:54 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y Nov 03 12:20:54 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:54 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y" returned: 0 in 0.308s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:54 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y Nov 03 12:20:54 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:54 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y" returned: 1 in 0.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_cbdz0f_y' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[95286745-a424-4626-8e19-db05c869bdeb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:54 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD Nov 03 12:20:54 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:55 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:55 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 was qcow2, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:20:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:55 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df Nov 03 12:20:55 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:56 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df" returned: 0 in 1.672s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:56 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6eb0a93-081d-4ff9-9d14-3a1f41f3f326_w1wdsr2qdevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:20:56 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Converted 112.00 MB image at 66.94 MB/s Nov 03 12:20:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:20:56 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1G Nov 03 12:20:56 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:20:57 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df 1G" returned: 0 in 0.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Downloaded image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}])) to volume 365bd300-d032-4c47-8265-a4b3a1d9f0df successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Temporary image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 for user e29ededffd274a4d87726060df0830d9 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Marking volume 365bd300-d032-4c47-8265-a4b3a1d9f0df as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Copying metadata from image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 to 365bd300-d032-4c47-8265-a4b3a1d9f0df. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Creating volume glance metadata for volume 365bd300-d032-4c47-8265-a4b3a1d9f0df backed by image c6eb0a93-081d-4ff9-9d14-3a1f41f3f326 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f983e-6412-455d-a711-5753248b5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365bd300-d032-4c47-8265-a4b3a1d9f0df', 'volume_size': 1, 'image_id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e719238d39d49648e7f86f080469b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c6eb0a93-081d-4ff9-9d14-3a1f41f3f326', 'created_at': datetime.datetime(2026, 11, 3, 10, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 10, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6eb0a93-081d-4ff9-9d14-3a1f41f3f326/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f582f-e312-4190-9b32-ff6b0a53958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:20:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Volume volume-365bd300-d032-4c47-8265-a4b3a1d9f0df (365bd300-d032-4c47-8265-a4b3a1d9f0df): created successfully Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f582f-e312-4190-9b32-ff6b0a53958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Flow 'volume_create_manager' (0ad201c6-880d-46fd-ae41-71ee9dbf2a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:20:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ae8f5b3a-cca4-4a04-95f3-868239a762bc tempest-TestShelveInstance-1831079098 None] Created volume successfully. Nov 03 12:21:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-376a8389-68b2-4461-92ba-f94dcde922eb req-6b97b8a5-6fbd-4491-9485-b9a597dee97d tempest-TestShelveInstance-1831079098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:21:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-376a8389-68b2-4461-92ba-f94dcde922eb req-6b97b8a5-6fbd-4491-9485-b9a597dee97d tempest-TestShelveInstance-1831079098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:21:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-376a8389-68b2-4461-92ba-f94dcde922eb req-6b97b8a5-6fbd-4491-9485-b9a597dee97d tempest-TestShelveInstance-1831079098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:21:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-376a8389-68b2-4461-92ba-f94dcde922eb req-6b97b8a5-6fbd-4491-9485-b9a597dee97d tempest-TestShelveInstance-1831079098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-365bd300-d032-4c47-8265-a4b3a1d9f0df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a23caa72-0bb5-48fa-b2da-79de733cb766', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:21:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-376a8389-68b2-4461-92ba-f94dcde922eb req-6b97b8a5-6fbd-4491-9485-b9a597dee97d tempest-TestShelveInstance-1831079098 None] attachment_update completed successfully. Nov 03 12:21:10 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:21:10 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:INSERT=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:21:24 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:21:24 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:21:24 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:21:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:21:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-7cf6755e-d601-404d-9c34-6f45de59ce82 req-03b844d9-4bed-45a8-bcd2-2718e560b6b3 tempest-TestShelveInstance-1831079098 None] Terminate volume connection completed successfully. Nov 03 12:21:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-7cf6755e-d601-404d-9c34-6f45de59ce82 req-03b844d9-4bed-45a8-bcd2-2718e560b6b3 tempest-TestShelveInstance-1831079098 None] Deleting attachment a23caa72-0bb5-48fa-b2da-79de733cb766. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-34c48c56-9df7-4a2f-8a08-ffe525125054 req-455172fd-a94a-4ecd-b131-94be1aac52a8 tempest-TestShelveInstance-1831079098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-34c48c56-9df7-4a2f-8a08-ffe525125054 req-455172fd-a94a-4ecd-b131-94be1aac52a8 tempest-TestShelveInstance-1831079098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-34c48c56-9df7-4a2f-8a08-ffe525125054 req-455172fd-a94a-4ecd-b131-94be1aac52a8 tempest-TestShelveInstance-1831079098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-34c48c56-9df7-4a2f-8a08-ffe525125054 req-455172fd-a94a-4ecd-b131-94be1aac52a8 tempest-TestShelveInstance-1831079098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-365bd300-d032-4c47-8265-a4b3a1d9f0df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd20a16b6-c8da-4aee-9422-c7443f85e068', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:21:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-34c48c56-9df7-4a2f-8a08-ffe525125054 req-455172fd-a94a-4ecd-b131-94be1aac52a8 tempest-TestShelveInstance-1831079098 None] attachment_update completed successfully. Nov 03 12:21:41 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:21:42 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:22:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-95a82a35-9ddb-41d8-b7c6-00293204dd75 tempest-TestShelveInstance-1831079098 None] Terminate volume connection completed successfully. Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-95a82a35-9ddb-41d8-b7c6-00293204dd75 tempest-TestShelveInstance-1831079098 None] Deleting attachment d20a16b6-c8da-4aee-9422-c7443f85e068. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Acquiring lock "cinder-365bd300-d032-4c47-8265-a4b3a1d9f0df-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "cinder-365bd300-d032-4c47-8265-a4b3a1d9f0df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Acquiring lock "cinder-quobyte-365bd300-d032-4c47-8265-a4b3a1d9f0df" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "cinder-quobyte-365bd300-d032-4c47-8265-a4b3a1d9f0df" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25216c1-e3db-47a8-a9ce-8a1686a3d03c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:00 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df Nov 03 12:22:00 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:00 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df" returned: 0 in 0.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:00 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df Nov 03 12:22:00 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:01 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-365bd300-d032-4c47-8265-a4b3a1d9f0df" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "cinder-quobyte-365bd300-d032-4c47-8265-a4b3a1d9f0df" released by "delete_volume" :: held 0.668s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.quota [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Created reservations ['e987f89d-4fe9-43ac-a586-c10a7a25991c', '07354c27-1f56-4716-adde-cf310a4856fc', '82f48b27-fa99-46bb-93eb-f55294ba0b46', 'ac318ec8-f628-4a08-81f3-6fa82cbdc224'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:01 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:22:01 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:01 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.manager [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:22:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Deleted volume successfully. Nov 03 12:22:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-78b2c167-d656-49bd-9b1a-72f3f6dd94e0 req-e070ef68-7d27-4577-908b-b192b4333623 tempest-TestShelveInstance-1831079098 None] Lock "cinder-365bd300-d032-4c47-8265-a4b3a1d9f0df-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:22:11 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:22:11 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:24 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:22:24 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:24 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:22:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Flow 'volume_create_manager' (8e180c71-d73b-4f74-a78f-361301377e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecbdae6-8288-41d7-b523-c47433e64799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecbdae6-8288-41d7-b523-c47433e64799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1774340460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d71c128-c6cd-46b5-bd04-5b093635e9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d06e589c9a444218c7f260b5d9c4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:22:33Z,use_quota=True,user_id='e1a6bd778a564b6895a1a10248a5e072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17e6517-4ce0-4200-b9ef-e6a3fd832960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17e6517-4ce0-4200-b9ef-e6a3fd832960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b26607-e5cb-4415-ba70-1d602caa6808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b26607-e5cb-4415-ba70-1d602caa6808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d71c128-c6cd-46b5-bd04-5b093635e9df', 'volume_name': 'volume-2d71c128-c6cd-46b5-bd04-5b093635e9df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3181ab79-183f-49fe-b52f-3e6c743b01f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3181ab79-183f-49fe-b52f-3e6c743b01f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54aa723e-e833-4b86-8d24-4d90d171fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Volume 2d71c128-c6cd-46b5-bd04-5b093635e9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d71c128-c6cd-46b5-bd04-5b093635e9df', 'volume_size': 1} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1774340460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d71c128-c6cd-46b5-bd04-5b093635e9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d06e589c9a444218c7f260b5d9c4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:22:33Z,use_quota=True,user_id='e1a6bd778a564b6895a1a10248a5e072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Creating volume 2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:22:33 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:33 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df 1073741824 Nov 03 12:22:33 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:33 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df 1073741824" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:22:33 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:22:33 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:22:34 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54aa723e-e833-4b86-8d24-4d90d171fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d71c128-c6cd-46b5-bd04-5b093635e9df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6c7486-4c90-47d0-a78e-76f0f38611a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:22:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Volume volume-2d71c128-c6cd-46b5-bd04-5b093635e9df (2d71c128-c6cd-46b5-bd04-5b093635e9df): created successfully Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6c7486-4c90-47d0-a78e-76f0f38611a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Flow 'volume_create_manager' (8e180c71-d73b-4f74-a78f-361301377e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:22:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-262d5994-a881-4c33-9f3a-53d0c3cee293 tempest-TestStampPattern-1096866492 None] Created volume successfully. Nov 03 12:22:44 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:22:44 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:23:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cdd233d9-8fd0-4ca5-9ca9-96c73c9d19bb req-67f7f526-9180-4d41-bf60-9262d887ab0e tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cdd233d9-8fd0-4ca5-9ca9-96c73c9d19bb req-67f7f526-9180-4d41-bf60-9262d887ab0e tempest-TestStampPattern-1096866492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cdd233d9-8fd0-4ca5-9ca9-96c73c9d19bb req-67f7f526-9180-4d41-bf60-9262d887ab0e tempest-TestStampPattern-1096866492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-cdd233d9-8fd0-4ca5-9ca9-96c73c9d19bb req-67f7f526-9180-4d41-bf60-9262d887ab0e tempest-TestStampPattern-1096866492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-2d71c128-c6cd-46b5-bd04-5b093635e9df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2733b7d-d491-4097-945c-345e09ce90a6', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:23:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-cdd233d9-8fd0-4ca5-9ca9-96c73c9d19bb req-67f7f526-9180-4d41-bf60-9262d887ab0e tempest-TestStampPattern-1096866492 None] attachment_update completed successfully. Nov 03 12:23:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-1646942c-f870-4685-8337-88fcca91f5f3 req-3a4496fe-08e6-49d6-a33d-e84ac7ac3e3c tempest-TestStampPattern-1096866492 None] Terminate volume connection completed successfully. Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-1646942c-f870-4685-8337-88fcca91f5f3 req-3a4496fe-08e6-49d6-a33d-e84ac7ac3e3c tempest-TestStampPattern-1096866492 None] Deleting attachment a2733b7d-d491-4097-945c-345e09ce90a6. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Creating offline snapshot 22710821-4d72-4406-8865-1aede77042d4 of volume 2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb431b-d3b8-445c-a320-b8c63d17a52e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:23:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:08 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:23:08 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:08 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:08 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 1G Nov 03 12:23:08 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:08 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 1G" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d71c128-c6cd-46b5-bd04-5b093635e9df -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:08 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d71c128-c6cd-46b5-bd04-5b093635e9df -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:23:08 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:09 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d71c128-c6cd-46b5-bd04-5b093635e9df -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.285s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:09 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 is being set with open permissions: ugo+rw Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:09 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:23:09 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:09 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:09 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info Nov 03 12:23:09 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:09 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info" returned: 0 in 0.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:09 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info is being set with open permissions: ugo+rw Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:09 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info Nov 03 12:23:09 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:09 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.info" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-58f06251-a26e-437a-8680-b53ca4475505 tempest-TestStampPattern-1096866492 None] Create snapshot completed successfully Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Flow 'volume_create_manager' (c4cc5edd-93f0-4470-be9e-f1a71c007752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa01cd-2fde-49b9-89ed-0b8de8011cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa01cd-2fde-49b9-89ed-0b8de8011cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-621697694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ec4b0-e602-400d-ad1e-76bf98cc7df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d06e589c9a444218c7f260b5d9c4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=22710821-4d72-4406-8865-1aede77042d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:23:17Z,use_quota=True,user_id='e1a6bd778a564b6895a1a10248a5e072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240a4e37-c1ed-4b09-ad2f-d8fe8fe0265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240a4e37-c1ed-4b09-ad2f-d8fe8fe0265c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284a749a-758e-46c8-a209-6786a672778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284a749a-758e-46c8-a209-6786a672778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f86ec4b0-e602-400d-ad1e-76bf98cc7df4', 'volume_name': 'volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4', 'volume_size': 1, 'snapshot_id': '22710821-4d72-4406-8865-1aede77042d4'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf350955-5c35-407a-8608-bd73fe341ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf350955-5c35-407a-8608-bd73fe341ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360576eb-f6d6-4cc7-abd2-488194129ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Volume f86ec4b0-e602-400d-ad1e-76bf98cc7df4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4', 'volume_size': 1, 'snapshot_id': '22710821-4d72-4406-8865-1aede77042d4'} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Creating volume f86ec4b0-e602-400d-ad1e-76bf98cc7df4 from snapshot 22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] snapshot: 22710821-4d72-4406-8865-1aede77042d4, volume: f86ec4b0-e602-400d-ad1e-76bf98cc7df4, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c616dcb2-8016-4acb-a338-e4fb4d60c1e9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:23:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:16 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:23:16 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:17 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d71c128-c6cd-46b5-bd04-5b093635e9df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3888a-ce7d-47b2-81eb-69c97ef41043]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:17 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:23:17 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:17 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.372s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:23:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:17 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 Nov 03 12:23:17 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:24 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:23:24 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:24 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.653s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:23:26 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" returned: 0 in 8.966s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:23:26 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Converted 1024.00 MB image at 114.17 MB/s Nov 03 12:23:26 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 is being set with open permissions: ugo+rw Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:23:26 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 Nov 03 12:23:26 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=17,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:23:26 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" released by "_copy_volume_from_snapshot" :: held 10.111s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" released by "_create_volume_from_snapshot" :: held 10.171s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.186s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360576eb-f6d6-4cc7-abd2-488194129ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4', 'volume_size': 1, 'snapshot_id': '22710821-4d72-4406-8865-1aede77042d4'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02db4781-828a-4800-bcb7-2b4f57b6891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:23:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Volume volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 (f86ec4b0-e602-400d-ad1e-76bf98cc7df4): created successfully Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02db4781-828a-4800-bcb7-2b4f57b6891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:23:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Flow 'volume_create_manager' (c4cc5edd-93f0-4470-be9e-f1a71c007752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:23:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-05c36d33-4cdd-40f3-9b48-35c5ffd0ca9c tempest-TestStampPattern-1096866492 None] Created volume successfully. Nov 03 12:23:36 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:23:42 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:23:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ee971fc9-4a11-46c2-b69c-df87f93c9baf req-ebad9d6a-8f97-4ab1-84e9-903d13a562ff tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:23:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ee971fc9-4a11-46c2-b69c-df87f93c9baf req-ebad9d6a-8f97-4ab1-84e9-903d13a562ff tempest-TestStampPattern-1096866492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:23:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ee971fc9-4a11-46c2-b69c-df87f93c9baf req-ebad9d6a-8f97-4ab1-84e9-903d13a562ff tempest-TestStampPattern-1096866492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-ee971fc9-4a11-46c2-b69c-df87f93c9baf req-ebad9d6a-8f97-4ab1-84e9-903d13a562ff tempest-TestStampPattern-1096866492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297', 'name': 'volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a3d48e1-fd93-4ff5-ad00-9298f8096f43', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:23:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-ee971fc9-4a11-46c2-b69c-df87f93c9baf req-ebad9d6a-8f97-4ab1-84e9-903d13a562ff tempest-TestStampPattern-1096866492 None] attachment_update completed successfully. Nov 03 12:23:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c76c3d05-5c72-4b0b-8e23-b946d76d776e req-3515a721-297c-44b7-bc99-d05ec02e938b tempest-TestStampPattern-1096866492 None] Terminate volume connection completed successfully. Nov 03 12:23:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c76c3d05-5c72-4b0b-8e23-b946d76d776e req-3515a721-297c-44b7-bc99-d05ec02e938b tempest-TestStampPattern-1096866492 None] Deleting attachment 6a3d48e1-fd93-4ff5-ad00-9298f8096f43. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-f86ec4b0-e602-400d-ad1e-76bf98cc7df4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "cinder-f86ec4b0-e602-400d-ad1e-76bf98cc7df4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82bd84-4077-4307-9b6f-9742620c3e8b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:01 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 Nov 03 12:24:01 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:01 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" returned: 0 in 0.344s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:01 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4 Nov 03 12:24:01 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:01 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-f86ec4b0-e602-400d-ad1e-76bf98cc7df4" released by "delete_volume" :: held 0.625s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Created reservations ['87f68be7-5a90-4912-9fc9-2715e871b0df', '1446c768-f72a-4de9-92de-6d32048e2140', 'fc27776f-0aa7-4e4e-a72f-f94d05403f08', 'b9a54ff0-4fa4-47c7-98d9-a9ba0b60a7c4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:02 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:02 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:02 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Deleted volume successfully. Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-79a8066c-a893-47c3-824a-fa71fec15900 tempest-TestStampPattern-1096866492 None] Lock "cinder-f86ec4b0-e602-400d-ad1e-76bf98cc7df4-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-22710821-4d72-4406-8865-1aede77042d4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-22710821-4d72-4406-8865-1aede77042d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Deleting offline snapshot 22710821-4d72-4406-8865-1aede77042d4 of volume 2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] snapshot_file for this snap is: volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c890101-cd73-413f-bd37-8c544c45f1f1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:02 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:24:02 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:03 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d71c128-c6cd-46b5-bd04-5b093635e9df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77af705-faf6-4a8f-9d44-94fc0cdedbd8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:03 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:24:03 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:03 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.506s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:03 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:24:03 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:03 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:04 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4 Nov 03 12:24:04 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:04 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df.22710821-4d72-4406-8865-1aede77042d4" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-22710821-4d72-4406-8865-1aede77042d4" released by "_delete_snapshot" :: held 1.508s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" released by "delete_snapshot" :: held 1.527s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Created reservations ['b5f44581-fa5c-4d44-a7a0-d5b80f6476fd', 'c23fd512-88da-4656-916c-d1fab1b3624c', 'e2ec4f2f-4d7a-4a8f-9c3f-6a3c7c3e1c52', 'a637a104-b101-4aeb-bf5d-c8dfd1d450db'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Delete snapshot completed successfully. Nov 03 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6d391581-d8fa-4e3e-b4b6-3bc46476cd99 tempest-TestStampPattern-1096866492 None] Lock "cinder-22710821-4d72-4406-8865-1aede77042d4-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-2d71c128-c6cd-46b5-bd04-5b093635e9df-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "cinder-2d71c128-c6cd-46b5-bd04-5b093635e9df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Acquiring lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[933b4537-2409-4114-ba10-6ad27f488bcc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:08 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:24:08 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:08 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.349s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:08 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df Nov 03 12:24:08 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:08 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2d71c128-c6cd-46b5-bd04-5b093635e9df" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "cinder-quobyte-2d71c128-c6cd-46b5-bd04-5b093635e9df" released by "delete_volume" :: held 0.649s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Created reservations ['00935616-3e48-4e55-b7bf-3f62a726d9d1', '4eac1ca9-e042-4a58-9538-c75e49fe55a9', '30adcb5a-81ac-4c7b-9b12-30880ec7b0d7', 'f14e7a89-9a0c-4bc1-9801-396e5cd07d37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:09 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:09 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:09 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Deleted volume successfully. Nov 03 12:24:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-91d1b3f6-1bb8-4d23-8c35-e01a0cd3b726 tempest-TestStampPattern-1096866492 None] Lock "cinder-2d71c128-c6cd-46b5-bd04-5b093635e9df-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:19 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:24:19 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (2d5afcf7-ec13-413c-a946-99f460cc152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b9f4a3-486b-4acf-a46b-381d2ed3c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b9f4a3-486b-4acf-a46b-381d2ed3c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104807779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a186da9-2fe6-4fc8-b5b9-34a482475210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:21Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed16060e-fa68-4028-8a89-5d1830e3035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed16060e-fa68-4028-8a89-5d1830e3035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcc23ca-2ecd-4340-903a-377daf539e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcc23ca-2ecd-4340-903a-377daf539e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a186da9-2fe6-4fc8-b5b9-34a482475210', 'volume_name': 'volume-2a186da9-2fe6-4fc8-b5b9-34a482475210', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcc1332-4761-49a9-9781-1b35b4c51c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcc1332-4761-49a9-9781-1b35b4c51c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8937ad-9cde-4f5f-afc6-0e92c115410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Volume 2a186da9-2fe6-4fc8-b5b9-34a482475210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a186da9-2fe6-4fc8-b5b9-34a482475210', 'volume_size': 1} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104807779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a186da9-2fe6-4fc8-b5b9-34a482475210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:21Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Creating volume 2a186da9-2fe6-4fc8-b5b9-34a482475210 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:21 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 1073741824 Nov 03 12:24:21 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (0fa1fff4-2c58-426f-9d37-073c850edac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4521d9d0-3935-4239-8e64-e372e2a32b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4521d9d0-3935-4239-8e64-e372e2a32b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836099984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a965dfc-b22c-40e3-b474-69d5a70a93fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:21Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f531854f-d2b9-4f22-86a9-f77965a06e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f531854f-d2b9-4f22-86a9-f77965a06e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac37b16-a3cc-4515-bd37-0ee356d04589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac37b16-a3cc-4515-bd37-0ee356d04589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a965dfc-b22c-40e3-b474-69d5a70a93fe', 'volume_name': 'volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506040ac-e253-4cff-8ff7-36c6ef8a2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506040ac-e253-4cff-8ff7-36c6ef8a2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec15d894-4a09-4087-b8b2-861e52a694f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Volume 3a965dfc-b22c-40e3-b474-69d5a70a93fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe', 'volume_size': 1} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:21 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 1073741824" returned: 0 in 0.489s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:21 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 Nov 03 12:24:21 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (8b2ee48e-efb6-4b04-b9ad-cee026d8224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b744a59e-9352-4454-a246-d7f6fc2bf9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b744a59e-9352-4454-a246-d7f6fc2bf9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239912339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a12291-74a9-4c6e-ab68-9da8a0e5300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:22Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba927815-cb15-41be-98f4-ac2187bbcf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba927815-cb15-41be-98f4-ac2187bbcf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761e6bb9-4a45-4674-9002-db6889976392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761e6bb9-4a45-4674-9002-db6889976392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a12291-74a9-4c6e-ab68-9da8a0e5300c', 'volume_name': 'volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455eae65-88ca-413e-ae50-683cc700c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455eae65-88ca-413e-ae50-683cc700c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487f374-ac1f-4234-8c36-c0b42bd0f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Volume 83a12291-74a9-4c6e-ab68-9da8a0e5300c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c', 'volume_size': 1} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:22 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836099984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a965dfc-b22c-40e3-b474-69d5a70a93fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:21Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Creating volume 3a965dfc-b22c-40e3-b474-69d5a70a93fe {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8937ad-9cde-4f5f-afc6-0e92c115410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a186da9-2fe6-4fc8-b5b9-34a482475210', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe 1073741824 Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fc5901-851b-4c65-b48e-5808d87689f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Volume volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 (2a186da9-2fe6-4fc8-b5b9-34a482475210): created successfully Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fc5901-851b-4c65-b48e-5808d87689f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (2d5afcf7-ec13-413c-a946-99f460cc152e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-69fb735b-2a97-4133-8065-5db44624202f tempest-CreateVolumesFromImageTest-372201401 None] Created volume successfully. Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (c8307628-9f74-4e17-8ccd-a02b1c67b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d36d180-524c-499e-b4e1-e066efe28074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d36d180-524c-499e-b4e1-e066efe28074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816507127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b5015b-f3aa-413b-a9ac-c52e5330cd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:22Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24c5e46-783e-4ca5-a59c-370deded3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24c5e46-783e-4ca5-a59c-370deded3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffb1dc9-1c9e-4fb3-963d-1d01778b41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffb1dc9-1c9e-4fb3-963d-1d01778b41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b5015b-f3aa-413b-a9ac-c52e5330cd6a', 'volume_name': 'volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2eb91-568d-4c8d-9615-e5e3a77f4237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2eb91-568d-4c8d-9615-e5e3a77f4237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a38c7-e4fa-4064-8d1c-ae07f9da98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Volume 63b5015b-f3aa-413b-a9ac-c52e5330cd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a', 'volume_size': 1} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:22 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe 1073741824" returned: 0 in 0.500s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:22 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe Nov 03 12:24:22 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (c1f965fb-bb45-47ba-8962-61d78acf4d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a7fd55-06c3-45ec-beab-7b3a3a9f4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a7fd55-06c3-45ec-beab-7b3a3a9f4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021379353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c382a79c-4508-4f2e-8a55-e51123b05ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:23Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53549998-ecd7-4117-9ce1-85ebc46fc34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53549998-ecd7-4117-9ce1-85ebc46fc34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3e7a2-f71c-4434-ae8d-5bf6ed45794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3e7a2-f71c-4434-ae8d-5bf6ed45794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c382a79c-4508-4f2e-8a55-e51123b05ca9', 'volume_name': 'volume-c382a79c-4508-4f2e-8a55-e51123b05ca9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d572339-ddf3-4b20-a296-597717536809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d572339-ddf3-4b20-a296-597717536809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583ef591-944d-4365-9184-03297db372c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Volume c382a79c-4508-4f2e-8a55-e51123b05ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c382a79c-4508-4f2e-8a55-e51123b05ca9', 'volume_size': 1} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:22 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe" returned: 0 in 0.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239912339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a12291-74a9-4c6e-ab68-9da8a0e5300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:22Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Creating volume 83a12291-74a9-4c6e-ab68-9da8a0e5300c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec15d894-4a09-4087-b8b2-861e52a694f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:22 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c 1073741824 Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410f2c26-ba30-43aa-a1a1-5e4ee5bcbb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:22 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Volume volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe (3a965dfc-b22c-40e3-b474-69d5a70a93fe): created successfully Nov 03 12:24:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410f2c26-ba30-43aa-a1a1-5e4ee5bcbb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (0fa1fff4-2c58-426f-9d37-073c850edac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0a94c9c6-ccd1-4dbd-82c7-61d7ec81fa0f tempest-CreateVolumesFromImageTest-372201401 None] Created volume successfully. Nov 03 12:24:23 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c 1073741824" returned: 0 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:23 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c Nov 03 12:24:23 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:23 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816507127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b5015b-f3aa-413b-a9ac-c52e5330cd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:22Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Creating volume 63b5015b-f3aa-413b-a9ac-c52e5330cd6a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:23 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a 1073741824 Nov 03 12:24:23 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487f374-ac1f-4234-8c36-c0b42bd0f107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbf5d60-9028-4ce7-a078-a5d3e9947e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Volume volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c (83a12291-74a9-4c6e-ab68-9da8a0e5300c): created successfully Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbf5d60-9028-4ce7-a078-a5d3e9947e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (8b2ee48e-efb6-4b04-b9ad-cee026d8224e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cee090fa-2edf-418c-a514-7a41d596c5a9 tempest-CreateVolumesFromImageTest-372201401 None] Created volume successfully. Nov 03 12:24:24 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a 1073741824" returned: 0 in 0.431s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:24 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:24 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:24 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:24 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:24 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021379353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c382a79c-4508-4f2e-8a55-e51123b05ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec752797888428ebb8bb71479e719f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:23Z,use_quota=True,user_id='8147034b7eef467aa1ba89606b325ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Creating volume c382a79c-4508-4f2e-8a55-e51123b05ca9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:24 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a38c7-e4fa-4064-8d1c-ae07f9da98c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:24 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 1073741824 Nov 03 12:24:24 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f16dce-e326-483e-a4d2-a6a90ae62bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:24:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Volume volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a (63b5015b-f3aa-413b-a9ac-c52e5330cd6a): created successfully Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f16dce-e326-483e-a4d2-a6a90ae62bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (c8307628-9f74-4e17-8ccd-a02b1c67b005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-470f4f41-8260-4d1a-92be-0e1ec10cd160 tempest-CreateVolumesFromImageTest-372201401 None] Created volume successfully. Nov 03 12:24:24 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 1073741824" returned: 0 in 0.407s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:24 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 Nov 03 12:24:24 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:25 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583ef591-944d-4365-9184-03297db372c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c382a79c-4508-4f2e-8a55-e51123b05ca9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134d19f5-4fb1-4f6b-8051-e0511eb3e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Volume volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 (c382a79c-4508-4f2e-8a55-e51123b05ca9): created successfully Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134d19f5-4fb1-4f6b-8051-e0511eb3e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Flow 'volume_create_manager' (c1f965fb-bb45-47ba-8962-61d78acf4d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fe51d92a-3d2e-4d7a-8d34-09ded53f6022 tempest-CreateVolumesFromImageTest-372201401 None] Created volume successfully. Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-c382a79c-4508-4f2e-8a55-e51123b05ca9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-c382a79c-4508-4f2e-8a55-e51123b05ca9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-quobyte-c382a79c-4508-4f2e-8a55-e51123b05ca9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-c382a79c-4508-4f2e-8a55-e51123b05ca9" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[54197e85-2588-4414-b3b8-93131c690f31]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:26 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 Nov 03 12:24:26 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:26 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:26 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9 Nov 03 12:24:26 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:26 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c382a79c-4508-4f2e-8a55-e51123b05ca9" returned: 0 in 0.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-c382a79c-4508-4f2e-8a55-e51123b05ca9" released by "delete_volume" :: held 0.643s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Created reservations ['40f21ced-00cd-43d7-8e0d-77f012776774', 'e8a773c1-0fec-4ec9-a3f5-8f2fe9ff8583', '2612a303-3f75-4056-aac5-a81fdbcf0d79', '2a41a4f6-371e-4549-b04d-6eb6ce6ce8fb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:26 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:26 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:27 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Deleted volume successfully. Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-41d52ba8-d02a-43bb-8422-38a1bd7a7cb0 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-c382a79c-4508-4f2e-8a55-e51123b05ca9-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-63b5015b-f3aa-413b-a9ac-c52e5330cd6a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-63b5015b-f3aa-413b-a9ac-c52e5330cd6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-quobyte-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d4f875-c3c7-485b-9333-504a14438b09]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:27 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a Nov 03 12:24:27 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:27 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" returned: 0 in 0.346s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:27 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a Nov 03 12:24:27 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:27 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-63b5015b-f3aa-413b-a9ac-c52e5330cd6a" released by "delete_volume" :: held 0.628s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Created reservations ['d8f00977-28b3-45b4-bb90-36d029e9817e', 'a7acf7a1-a806-4cbf-b541-0e9ce6f8cf4a', '51f7422c-fe2e-4749-bc28-3c579a78bc2a', 'c83b56ce-bcec-404c-8b0a-04d70cdf804f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:28 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:28 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:28 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Deleted volume successfully. Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1933b541-4885-4992-b9ac-fd6b21694200 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-63b5015b-f3aa-413b-a9ac-c52e5330cd6a-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-83a12291-74a9-4c6e-ab68-9da8a0e5300c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-83a12291-74a9-4c6e-ab68-9da8a0e5300c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-quobyte-83a12291-74a9-4c6e-ab68-9da8a0e5300c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-83a12291-74a9-4c6e-ab68-9da8a0e5300c" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebecc0c-d477-4900-bba8-519cce102b2f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:28 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c Nov 03 12:24:28 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:28 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:28 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c Nov 03 12:24:28 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:29 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-83a12291-74a9-4c6e-ab68-9da8a0e5300c" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-83a12291-74a9-4c6e-ab68-9da8a0e5300c" released by "delete_volume" :: held 0.642s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Created reservations ['d049ddec-bb2a-4b78-aab7-9b0a592509c7', 'c1608dad-122c-492a-acff-50f506540b40', 'adca8248-df73-4676-9acf-c82b11d0eab9', '1950fa68-0c28-4891-827e-0a1bac59caf5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:29 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:29 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:29 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Deleted volume successfully. Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f2d82812-6aa8-4209-a999-6ca487ad9682 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-83a12291-74a9-4c6e-ab68-9da8a0e5300c-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-3a965dfc-b22c-40e3-b474-69d5a70a93fe-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-3a965dfc-b22c-40e3-b474-69d5a70a93fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-quobyte-3a965dfc-b22c-40e3-b474-69d5a70a93fe" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-3a965dfc-b22c-40e3-b474-69d5a70a93fe" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d89a7-ced1-410c-bb21-5d13953bcedc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:29 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe Nov 03 12:24:29 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:30 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:30 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe Nov 03 12:24:30 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:30 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3a965dfc-b22c-40e3-b474-69d5a70a93fe" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-3a965dfc-b22c-40e3-b474-69d5a70a93fe" released by "delete_volume" :: held 0.642s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Created reservations ['2fc04498-09cb-41b3-b484-53eafb050035', '0d45ce62-6340-42b9-9f08-475a435c77e1', '849d1866-beb9-4477-8e73-c86de145ddb7', '5d177c34-f523-4759-a3ec-884ed84190e4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:30 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:30 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:30 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Deleted volume successfully. Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eba275-c467-41e2-b6bb-e7388094a9c7 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-3a965dfc-b22c-40e3-b474-69d5a70a93fe-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-2a186da9-2fe6-4fc8-b5b9-34a482475210-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-2a186da9-2fe6-4fc8-b5b9-34a482475210-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "cinder-quobyte-2a186da9-2fe6-4fc8-b5b9-34a482475210" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-2a186da9-2fe6-4fc8-b5b9-34a482475210" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[88964d56-be07-4b73-9224-d99ccccb1e44]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:30 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 Nov 03 12:24:30 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:31 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:31 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210 Nov 03 12:24:31 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:31 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a186da9-2fe6-4fc8-b5b9-34a482475210" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-quobyte-2a186da9-2fe6-4fc8-b5b9-34a482475210" released by "delete_volume" :: held 0.640s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Created reservations ['ed1f932a-084c-4aeb-bc01-a8b6a69558f0', '7e7f7244-7dee-4280-88f2-f91287d63739', 'c5e71fa0-0b89-4486-b633-6a19e64f0db5', 'f40c4cd8-eb20-40be-8f83-d5cd43922e6d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:31 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:31 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:31 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Deleted volume successfully. Nov 03 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-484fc55d-2fde-499b-9d82-5ceda95f6f49 tempest-CreateVolumesFromImageTest-372201401 None] Lock "cinder-2a186da9-2fe6-4fc8-b5b9-34a482475210-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (a0e5b2a0-1842-4f94-aeb8-9d3c948c6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f28cd3-3fed-47c8-b15e-d2d4c23e507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f28cd3-3fed-47c8-b15e-d2d4c23e507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2098722921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d6b9c9-707b-47e5-adb7-f84ef6394bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:35Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87d799-b7c4-447d-86a6-d209eaf6318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87d799-b7c4-447d-86a6-d209eaf6318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7e539d-2fbf-47e6-8ac9-f5fb4f053640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7e539d-2fbf-47e6-8ac9-f5fb4f053640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d6b9c9-707b-47e5-adb7-f84ef6394bbc', 'volume_name': 'volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f136eb-1229-4323-b016-ccc046324aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f136eb-1229-4323-b016-ccc046324aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a6a79-4884-47f6-b63b-712163283806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Volume 99d6b9c9-707b-47e5-adb7-f84ef6394bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc', 'volume_size': 1} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2098722921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d6b9c9-707b-47e5-adb7-f84ef6394bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:35Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Creating volume 99d6b9c9-707b-47e5-adb7-f84ef6394bbc {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:35 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:35 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc 1073741824 Nov 03 12:24:35 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:35 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc 1073741824" returned: 0 in 0.404s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:35 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc Nov 03 12:24:35 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:35 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a6a79-4884-47f6-b63b-712163283806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a35d437-7964-4c59-96c7-f5e1d55a1a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Volume volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc (99d6b9c9-707b-47e5-adb7-f84ef6394bbc): created successfully Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a35d437-7964-4c59-96c7-f5e1d55a1a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (a0e5b2a0-1842-4f94-aeb8-9d3c948c6119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a7ae9fd6-04ec-479d-88e8-e24fc0d13c9c tempest-ProjectReaderTests-1445977782 None] Created volume successfully. Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-99d6b9c9-707b-47e5-adb7-f84ef6394bbc-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-99d6b9c9-707b-47e5-adb7-f84ef6394bbc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-quobyte-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528f820-6668-4129-8c3e-d39c108260bc]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:36 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc Nov 03 12:24:36 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:36 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" returned: 0 in 0.364s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:36 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc Nov 03 12:24:36 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:36 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-99d6b9c9-707b-47e5-adb7-f84ef6394bbc" released by "delete_volume" :: held 0.645s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Created reservations ['7d267c44-e8ea-4a58-8c4e-148270143d48', '68bc3381-779b-4966-9a9a-aa47f1230f73', 'dc529d8a-1219-4464-a98c-f86d4e99eea4', 'e535238a-8205-4a92-b11a-75c07aed73b2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:37 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:37 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:37 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Deleted volume successfully. Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1703d1de-62c2-4473-8a15-45d163d6f971 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-99d6b9c9-707b-47e5-adb7-f84ef6394bbc-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (6d8579f6-4a15-4675-b9a0-d007e83d8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb27f11-b9a4-4063-b2af-65fd9ff45adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb27f11-b9a4-4063-b2af-65fd9ff45adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540118179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ef93dc-e6b5-42dc-95fb-8c05f8408743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:38Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861eef33-5cea-42c4-b3cf-d0d5593a3946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861eef33-5cea-42c4-b3cf-d0d5593a3946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccd66c4-2c7c-4408-bbf6-7f3d1be551e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccd66c4-2c7c-4408-bbf6-7f3d1be551e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ef93dc-e6b5-42dc-95fb-8c05f8408743', 'volume_name': 'volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7df301-8151-46fd-b409-5b3970d848bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7df301-8151-46fd-b409-5b3970d848bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35523fdd-885d-4ed8-87e7-d82b99390ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Volume e0ef93dc-e6b5-42dc-95fb-8c05f8408743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743', 'volume_size': 1} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540118179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ef93dc-e6b5-42dc-95fb-8c05f8408743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:38Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Creating volume e0ef93dc-e6b5-42dc-95fb-8c05f8408743 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:37 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 1073741824 Nov 03 12:24:37 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:38 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 1073741824" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:38 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 Nov 03 12:24:38 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:38 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" returned: 0 in 0.235s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35523fdd-885d-4ed8-87e7-d82b99390ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2311a3bd-144b-4cb8-8b5d-3cbe9c9861f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:38 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Volume volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 (e0ef93dc-e6b5-42dc-95fb-8c05f8408743): created successfully Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2311a3bd-144b-4cb8-8b5d-3cbe9c9861f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (6d8579f6-4a15-4675-b9a0-d007e83d8b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9d98d6dd-10cc-4270-a27d-958f3397fb83 tempest-ProjectReaderTests-1445977782 None] Created volume successfully. Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-e0ef93dc-e6b5-42dc-95fb-8c05f8408743-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-e0ef93dc-e6b5-42dc-95fb-8c05f8408743-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-quobyte-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" acquired by "delete_volume" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bf887-d333-42b1-8170-4b33e771c384]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:39 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 Nov 03 12:24:39 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:39 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:39 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743 Nov 03 12:24:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:39 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-e0ef93dc-e6b5-42dc-95fb-8c05f8408743" released by "delete_volume" :: held 0.645s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Created reservations ['e5d855ba-9194-4a27-a5cf-936f3a729b6d', '5bb2ef27-36ce-447e-832f-7e4fd0d97e97', 'a1808137-8a15-45f5-80b0-6efb63fb6540', 'e08c5d9b-0d05-4f87-8be7-c72af1d8df03'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:39 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:39 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:39 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Deleted volume successfully. Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a6b78703-48a6-4b7c-999b-36eac64a62a3 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-e0ef93dc-e6b5-42dc-95fb-8c05f8408743-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (71321639-ecf5-4585-ad29-9f7138656a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8635e3-a59c-407e-9dc1-57ba865307ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8635e3-a59c-407e-9dc1-57ba865307ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867476001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f920658a-bab7-45c1-9b03-eef3f2e84dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:40Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793cd20e-4ab8-4dd1-96ee-e8fdf34ed931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793cd20e-4ab8-4dd1-96ee-e8fdf34ed931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e08edb4-d563-40f7-a1c6-0008891feb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e08edb4-d563-40f7-a1c6-0008891feb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f920658a-bab7-45c1-9b03-eef3f2e84dc3', 'volume_name': 'volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a033af-eca0-4fa4-939e-a0570c469c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a033af-eca0-4fa4-939e-a0570c469c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac948551-0507-48b7-9e04-a0ecfad1a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Volume f920658a-bab7-45c1-9b03-eef3f2e84dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3', 'volume_size': 1} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867476001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f920658a-bab7-45c1-9b03-eef3f2e84dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:40Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Creating volume f920658a-bab7-45c1-9b03-eef3f2e84dc3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:40 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:40 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 1073741824 Nov 03 12:24:40 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:40 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 1073741824" returned: 0 in 0.402s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:41 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 Nov 03 12:24:41 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:41 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac948551-0507-48b7-9e04-a0ecfad1a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdcc200-5e8c-467e-8546-58c565a5e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:41 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Volume volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 (f920658a-bab7-45c1-9b03-eef3f2e84dc3): created successfully Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdcc200-5e8c-467e-8546-58c565a5e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (71321639-ecf5-4585-ad29-9f7138656a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1a2c90a3-82e6-452b-b110-444718131868 tempest-ProjectReaderTests-1445977782 None] Created volume successfully. Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-f920658a-bab7-45c1-9b03-eef3f2e84dc3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-f920658a-bab7-45c1-9b03-eef3f2e84dc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-quobyte-f920658a-bab7-45c1-9b03-eef3f2e84dc3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-f920658a-bab7-45c1-9b03-eef3f2e84dc3" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b90b019-1c6e-42ee-8f9a-20685e9b07d1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:41 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 Nov 03 12:24:41 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:42 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:42 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3 Nov 03 12:24:42 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:42 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f920658a-bab7-45c1-9b03-eef3f2e84dc3" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-f920658a-bab7-45c1-9b03-eef3f2e84dc3" released by "delete_volume" :: held 0.641s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Created reservations ['5b059781-dbd3-4a1c-882a-d3bd2d2895fd', 'aefe3340-968e-45b9-b0df-3d8ed534e91c', '2888fbcd-dbac-4a3a-beb5-f6f7c97ce631', 'de317b81-6cac-4052-84db-07ccf69f4170'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:42 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:42 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:42 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Deleted volume successfully. Nov 03 12:24:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-619be7fa-5695-44de-b205-4626ccc92e17 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-f920658a-bab7-45c1-9b03-eef3f2e84dc3-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (3f54a929-df92-4988-bd0a-bf239879ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c31d91-61a8-4d45-8175-9e66eb414380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c31d91-61a8-4d45-8175-9e66eb414380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153672450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28755086-d0c6-4a68-94d4-1ba40d15bc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:43Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e3b913-ac3e-4ea7-a983-29d7e3ae7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e3b913-ac3e-4ea7-a983-29d7e3ae7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd107c2-8188-4687-b89a-76645d083138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd107c2-8188-4687-b89a-76645d083138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28755086-d0c6-4a68-94d4-1ba40d15bc63', 'volume_name': 'volume-28755086-d0c6-4a68-94d4-1ba40d15bc63', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd0831c-4307-471e-9e06-8acc90dc1d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd0831c-4307-471e-9e06-8acc90dc1d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21326e-2737-49e9-855b-0c5b92c8a133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Volume 28755086-d0c6-4a68-94d4-1ba40d15bc63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28755086-d0c6-4a68-94d4-1ba40d15bc63', 'volume_size': 1} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153672450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28755086-d0c6-4a68-94d4-1ba40d15bc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3a70faa2364aa1a82d51971f8e99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:43Z,use_quota=True,user_id='2c2656effdf443c89a0408d9f476914f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Creating volume 28755086-d0c6-4a68-94d4-1ba40d15bc63 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:43 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 1073741824 Nov 03 12:24:43 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:43 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 1073741824" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:43 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 Nov 03 12:24:43 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:43 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63" returned: 0 in 0.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21326e-2737-49e9-855b-0c5b92c8a133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28755086-d0c6-4a68-94d4-1ba40d15bc63', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116a28dd-68a8-4c8d-be70-7630a5f535df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Volume volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 (28755086-d0c6-4a68-94d4-1ba40d15bc63): created successfully Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116a28dd-68a8-4c8d-be70-7630a5f535df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Flow 'volume_create_manager' (3f54a929-df92-4988-bd0a-bf239879ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6bad344d-5efd-4cc8-a0df-a991d122ff90 tempest-ProjectReaderTests-1445977782 None] Created volume successfully. Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-28755086-d0c6-4a68-94d4-1ba40d15bc63-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-28755086-d0c6-4a68-94d4-1ba40d15bc63-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "cinder-quobyte-28755086-d0c6-4a68-94d4-1ba40d15bc63" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-28755086-d0c6-4a68-94d4-1ba40d15bc63" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0108d2-0986-4e5e-880c-0364de291e00]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:44 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 Nov 03 12:24:44 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:44 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63" returned: 0 in 0.385s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:44 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63 Nov 03 12:24:44 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:44 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-28755086-d0c6-4a68-94d4-1ba40d15bc63" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-quobyte-28755086-d0c6-4a68-94d4-1ba40d15bc63" released by "delete_volume" :: held 0.676s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Created reservations ['a9a94970-e1be-4038-af77-07d16c0c565f', '32721cac-d1f3-4685-a79e-84bcf26cbddb', '065aea0a-d54e-4cd0-b1c9-190870bfe16d', '94cc9284-bebe-4da8-841b-9af9ffb118d0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:45 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:24:45 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:45 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:24:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Deleted volume successfully. Nov 03 12:24:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad93aacd-d1a4-43e2-bed7-30c0865bb984 tempest-ProjectReaderTests-1445977782 None] Lock "cinder-28755086-d0c6-4a68-94d4-1ba40d15bc63-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:24:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=68,cinder:UPDATE=107,cinder:DELETE=9,cinder:INSERT=20 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:24:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=58,cinder:UPDATE=91,cinder:INSERT=25,cinder:DELETE=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (0be8a7e5-dd56-4a22-91c5-50642eadd22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae743b-be09-4524-ac09-de32f6d373e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae743b-be09-4524-ac09-de32f6d373e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-718700017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4719c341-b305-46f8-9581-ee3665ae5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a18d004-03e9-46cf-95b2-001e11b79f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a18d004-03e9-46cf-95b2-001e11b79f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b084139-44c8-4436-8a14-0b2e85c3ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b084139-44c8-4436-8a14-0b2e85c3ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4719c341-b305-46f8-9581-ee3665ae5b86', 'volume_name': 'volume-4719c341-b305-46f8-9581-ee3665ae5b86', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e3937-bd76-4400-81ee-3e9140085a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e3937-bd76-4400-81ee-3e9140085a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169c7f2-db1e-4644-9f5c-d910e680dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Volume 4719c341-b305-46f8-9581-ee3665ae5b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4719c341-b305-46f8-9581-ee3665ae5b86', 'volume_size': 1} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-718700017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4719c341-b305-46f8-9581-ee3665ae5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Creating volume 4719c341-b305-46f8-9581-ee3665ae5b86 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:57 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 1073741824 Nov 03 12:24:57 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (1e81c888-7766-4b19-a218-3944d90914ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8151f7-e5c0-47be-ac64-8f0220f113d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (b760a5c6-5e7e-4364-b889-e6c2543ce1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0161724-377e-4df2-bf9a-679f9e523548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8151f7-e5c0-47be-ac64-8f0220f113d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721553436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5829a8-a8a3-4f12-8366-d4a586a99132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e55e1a3-598c-46a3-b40e-a129af7e38ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e55e1a3-598c-46a3-b40e-a129af7e38ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c31ab-6816-4740-a7a8-de28773bc758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c31ab-6816-4740-a7a8-de28773bc758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5829a8-a8a3-4f12-8366-d4a586a99132', 'volume_name': 'volume-5f5829a8-a8a3-4f12-8366-d4a586a99132', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0691b2-b632-4be9-bacb-9295d2c46f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0691b2-b632-4be9-bacb-9295d2c46f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29a1816-54ac-4e39-8658-cb0050b8c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Volume 5f5829a8-a8a3-4f12-8366-d4a586a99132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5829a8-a8a3-4f12-8366-d4a586a99132', 'volume_size': 1} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0161724-377e-4df2-bf9a-679f9e523548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906312716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b14b0c4-327e-489f-ab79-97f66cb24ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163cd435-17d3-4f0d-b43e-303c9647fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163cd435-17d3-4f0d-b43e-303c9647fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16930cb-ecce-4060-9386-a35f1bd0ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16930cb-ecce-4060-9386-a35f1bd0ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b14b0c4-327e-489f-ab79-97f66cb24ff0', 'volume_name': 'volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a4cda-9905-47bf-8957-b2bef9c0f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a4cda-9905-47bf-8957-b2bef9c0f89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c24d3cc-3fd7-4b9a-8b13-ea24218436a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume 2b14b0c4-327e-489f-ab79-97f66cb24ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0', 'volume_size': 1} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (f2f9ea13-83fb-4f16-85ab-d64b4a57622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c72d4-6d69-41ee-8fd0-b01115f35d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c72d4-6d69-41ee-8fd0-b01115f35d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212512382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e40e82-9ba8-45d1-9977-666e91ddb725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44e0df1-5bd3-4baa-9cc4-a79d7d637601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44e0df1-5bd3-4baa-9cc4-a79d7d637601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b82a6-a8d4-4be4-8ef1-7ecf5e993490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b82a6-a8d4-4be4-8ef1-7ecf5e993490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e40e82-9ba8-45d1-9977-666e91ddb725', 'volume_name': 'volume-11e40e82-9ba8-45d1-9977-666e91ddb725', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb378556-c2f2-44b1-9cf9-5d9eb8538150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb378556-c2f2-44b1-9cf9-5d9eb8538150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02b9d5c-35f6-41d7-a16e-f3d986b46ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Volume 11e40e82-9ba8-45d1-9977-666e91ddb725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e40e82-9ba8-45d1-9977-666e91ddb725', 'volume_size': 1} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:58 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 1073741824" returned: 0 in 0.729s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:58 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 Nov 03 12:24:58 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (dec8fb0d-74d0-4bb1-95cb-aad2d3a2b0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0b9369-9947-43d4-a70c-419fadefe2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0b9369-9947-43d4-a70c-419fadefe2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2106842452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d04855-f308-49ee-98e7-ce1a0b3309aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:59Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c384fa-c459-4312-8837-faf6e4ec825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c384fa-c459-4312-8837-faf6e4ec825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aebe859-bab5-44fc-b7f0-4dc492ac6053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aebe859-bab5-44fc-b7f0-4dc492ac6053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d04855-f308-49ee-98e7-ce1a0b3309aa', 'volume_name': 'volume-05d04855-f308-49ee-98e7-ce1a0b3309aa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3439d16f-5130-4f45-ad2e-88d3ca96ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3439d16f-5130-4f45-ad2e-88d3ca96ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ace50f1-68bb-4027-8b56-76febc84e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Volume 05d04855-f308-49ee-98e7-ce1a0b3309aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d04855-f308-49ee-98e7-ce1a0b3309aa', 'volume_size': 1} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:59 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86" returned: 0 in 0.442s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721553436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5829a8-a8a3-4f12-8366-d4a586a99132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Creating volume 5f5829a8-a8a3-4f12-8366-d4a586a99132 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:24:59 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169c7f2-db1e-4644-9f5c-d910e680dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4719c341-b305-46f8-9581-ee3665ae5b86', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5657855b-ac4e-4b40-b45c-c0ef293a42cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 1073741824 Nov 03 12:24:59 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Volume volume-4719c341-b305-46f8-9581-ee3665ae5b86 (4719c341-b305-46f8-9581-ee3665ae5b86): created successfully Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5657855b-ac4e-4b40-b45c-c0ef293a42cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (0be8a7e5-dd56-4a22-91c5-50642eadd22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-731622d9-4bae-4f14-9df2-5267c989e316 tempest-CreateVolumesFromImageTest-402313878 None] Created volume successfully. Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (5b49f534-b3db-43bd-adcd-b6b4e6e1b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f45d6-48ad-4fc3-b23c-931f77390d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f45d6-48ad-4fc3-b23c-931f77390d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278536805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f838347-ec74-4bcd-8be4-800de13bb208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:59Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b11414-cfbc-45dd-b68d-27608c59a1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b11414-cfbc-45dd-b68d-27608c59a1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c841b2b2-ede7-409a-a8d4-4b26d4986dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c841b2b2-ede7-409a-a8d4-4b26d4986dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f838347-ec74-4bcd-8be4-800de13bb208', 'volume_name': 'volume-9f838347-ec74-4bcd-8be4-800de13bb208', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21255f8-6b5e-4152-a0e0-90c0421a152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21255f8-6b5e-4152-a0e0-90c0421a152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11d52a5-0d53-4aa3-9fd3-8673e5447e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:24:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Volume 9f838347-ec74-4bcd-8be4-800de13bb208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f838347-ec74-4bcd-8be4-800de13bb208', 'volume_size': 1} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:24:59 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 1073741824" returned: 0 in 0.584s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:24:59 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 Nov 03 12:24:59 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:24:59 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132" returned: 0 in 0.281s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906312716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b14b0c4-327e-489f-ab79-97f66cb24ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume 2b14b0c4-327e-489f-ab79-97f66cb24ff0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29a1816-54ac-4e39-8658-cb0050b8c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5829a8-a8a3-4f12-8366-d4a586a99132', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb49577-083a-4f30-aca9-04e6f3a09428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:00 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 1073741824 Nov 03 12:25:00 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Volume volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 (5f5829a8-a8a3-4f12-8366-d4a586a99132): created successfully Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb49577-083a-4f30-aca9-04e6f3a09428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (1e81c888-7766-4b19-a218-3944d90914ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-371da7d1-2471-4afb-b405-d0ada25b486a tempest-CreateVolumesFromImageTest-402313878 None] Created volume successfully. Nov 03 12:25:00 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 1073741824" returned: 0 in 0.588s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Flow 'volume_create_manager' (e69833b1-088d-4d90-a306-7915737fcb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c1b6e4-8882-4e54-8b4d-0aa18e1988d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:00 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 Nov 03 12:25:00 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c1b6e4-8882-4e54-8b4d-0aa18e1988d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16364608-ae7b-4838-8037-b6c3a04214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6c0e50e3034f40a57909022a6d51b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:01Z,use_quota=True,user_id='df25ccf16f5f4237abf46ab9754dfeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269aacce-f994-42bb-b8fb-1067b1876921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269aacce-f994-42bb-b8fb-1067b1876921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee63323-7f43-41ad-854a-a685a43745d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:00 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:25:01 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0" returned: 0 in 0.278s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212512382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e40e82-9ba8-45d1-9977-666e91ddb725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:58Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Creating volume 11e40e82-9ba8-45d1-9977-666e91ddb725 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c24d3cc-3fd7-4b9a-8b13-ea24218436a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f594ee9-c16d-41ec-a769-ed8b816042af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:01 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 1073741824 Nov 03 12:25:01 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 (2b14b0c4-327e-489f-ab79-97f66cb24ff0): created successfully Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f594ee9-c16d-41ec-a769-ed8b816042af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (b760a5c6-5e7e-4364-b889-e6c2543ce1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7a32db63-2645-4cdd-b787-8a31bc2a24b6 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee63323-7f43-41ad-854a-a685a43745d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16364608-ae7b-4838-8037-b6c3a04214da', 'volume_name': 'volume-16364608-ae7b-4838-8037-b6c3a04214da', 'volume_size': 1, 'image_id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56518afe7a2f161f67473f7dbd7ed649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f6c0e50e3034f40a57909022a6d51b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d1cf849d015d5865eb8964afa076fcbcac75266e5037dd5766ae121949bb8d8bcaeec6a1b34889a2a1744b5adcd4a49bcd6324f5568665482b00fdf5f832cc', 'id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980077a0-26ef-4cab-b8e0-1aa6da0ddbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980077a0-26ef-4cab-b8e0-1aa6da0ddbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774aea29-843f-44be-8143-e6f0464013f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Volume 16364608-ae7b-4838-8037-b6c3a04214da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16364608-ae7b-4838-8037-b6c3a04214da', 'volume_size': 1, 'image_id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56518afe7a2f161f67473f7dbd7ed649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f6c0e50e3034f40a57909022a6d51b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d1cf849d015d5865eb8964afa076fcbcac75266e5037dd5766ae121949bb8d8bcaeec6a1b34889a2a1744b5adcd4a49bcd6324f5568665482b00fdf5f832cc', 'id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2/file', 'properties': {}}, 'image_service': } Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Trying to clone 16364608-ae7b-4838-8037-b6c3a04214da from image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Image download 0.00 MB at 0.00 MB/s Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93fafd8-e707-44be-9bae-13d279c35ce6]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:01 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:01 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:01 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 1073741824" returned: 0 in 0.547s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:01 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 Nov 03 12:25:01 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:01 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:01 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:01 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Flow 'volume_create_manager' (29f5da30-369c-472b-a374-128227c32240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaecd694-2317-44d8-b127-261f85bd082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:01 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725" returned: 0 in 0.333s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2106842452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d04855-f308-49ee-98e7-ce1a0b3309aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:59Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Creating volume 05d04855-f308-49ee-98e7-ce1a0b3309aa {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaecd694-2317-44d8-b127-261f85bd082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef52625d-7183-45bb-ac36-a6480cd411e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4667f846d24f4d818a3ee4e6d0486ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:02Z,use_quota=True,user_id='443d985bac7f414ba9a2a0406408b9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46eb9e23-779c-40fb-9fbb-af6761fa8c82),volume_type_id=46eb9e23-779c-40fb-9fbb-af6761fa8c82)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa 1073741824 Nov 03 12:25:02 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70896ce-c701-4cd2-b2d5-beb3b0fd5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70896ce-c701-4cd2-b2d5-beb3b0fd5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf305509-02f7-444a-8cc7-08bc80e0d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02b9d5c-35f6-41d7-a16e-f3d986b46ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e40e82-9ba8-45d1-9977-666e91ddb725', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78060b-9cce-4548-9ba1-acab71290a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Volume volume-11e40e82-9ba8-45d1-9977-666e91ddb725 (11e40e82-9ba8-45d1-9977-666e91ddb725): created successfully Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78060b-9cce-4548-9ba1-acab71290a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (f2f9ea13-83fb-4f16-85ab-d64b4a57622a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c321d9f0-0489-46ff-97ae-828976145908 tempest-CreateVolumesFromImageTest-402313878 None] Created volume successfully. Nov 03 12:25:02 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Temporary image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 is fetched for user df25ccf16f5f4237abf46ab9754dfeec. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a91155-27e5-442a-85c3-237c3ee5015f]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf305509-02f7-444a-8cc7-08bc80e0d112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef52625d-7183-45bb-ac36-a6480cd411e4', 'volume_name': 'volume-ef52625d-7183-45bb-ac36-a6480cd411e4', 'volume_size': 1, 'image_id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37afd6cfcd9eb134f6246646c49a702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4667f846d24f4d818a3ee4e6d0486ad6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b80290de353506788455b4e0a7ef3400eb31160bc61b530a9ec50bd6d42fc652cddc8c583d5bbed79a1ddb2d7deae88cc2ca5d223a8779d91e81284bd71fd9d5', 'id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd877871-2580-4cc7-81ad-9a2a91b1eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd877871-2580-4cc7-81ad-9a2a91b1eb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62011b0-11f5-4f3a-a11b-3e79cf07ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Volume ef52625d-7183-45bb-ac36-a6480cd411e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef52625d-7183-45bb-ac36-a6480cd411e4', 'volume_size': 1, 'image_id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37afd6cfcd9eb134f6246646c49a702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4667f846d24f4d818a3ee4e6d0486ad6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b80290de353506788455b4e0a7ef3400eb31160bc61b530a9ec50bd6d42fc652cddc8c583d5bbed79a1ddb2d7deae88cc2ca5d223a8779d91e81284bd71fd9d5', 'id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Trying to clone ef52625d-7183-45bb-ac36-a6480cd411e4 from image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (ec64bac6-ae17-4578-83f7-1259c22f2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e817fe-0d2c-472c-9489-54161dad6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:02 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e817fe-0d2c-472c-9489-54161dad6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053580450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d30a85-c429-463d-96ca-f00903eeda59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:02Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75882052-9dfb-4aae-96c0-40d6f3d6f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75882052-9dfb-4aae-96c0-40d6f3d6f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10d17f1-9a4c-4155-874f-5157139b1097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10d17f1-9a4c-4155-874f-5157139b1097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d30a85-c429-463d-96ca-f00903eeda59', 'volume_name': 'volume-e1d30a85-c429-463d-96ca-f00903eeda59', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983bf37c-4532-45c4-a5f4-96c5e039f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983bf37c-4532-45c4-a5f4-96c5e039f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8204f7-7243-4080-941f-ce6a402e3466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume e1d30a85-c429-463d-96ca-f00903eeda59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d30a85-c429-463d-96ca-f00903eeda59', 'volume_size': 1} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:25:02 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Image download 0.00 MB at 0.00 MB/s Nov 03 12:25:02 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa 1073741824" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def2d09-d905-4864-bb34-1d32c4f2cd03]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:02 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:02 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa Nov 03 12:25:02 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:02 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:02 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:02 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:02 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (0f744965-6aa3-4450-bfb9-d69a57fb84e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d425bd-92b2-4ee0-bf3a-39ba768bf0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d425bd-92b2-4ee0-bf3a-39ba768bf0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300182577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1eafb72-e1ba-4358-9b7e-0131b48c0459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:03Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1582c6-6dad-4b78-9659-d7debfd5d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1582c6-6dad-4b78-9659-d7debfd5d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ffd0c1-65f8-46cd-9d79-d9e63e752a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ffd0c1-65f8-46cd-9d79-d9e63e752a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1eafb72-e1ba-4358-9b7e-0131b48c0459', 'volume_name': 'volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3efc4c8-4c96-4ef4-b1ca-a22970c8e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3efc4c8-4c96-4ef4-b1ca-a22970c8e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277afd87-7d7d-4eeb-be9f-2ff1b2edc8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume a1eafb72-e1ba-4358-9b7e-0131b48c0459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459', 'volume_size': 1} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:03 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:03 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:03 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 1 in 0.501s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa" returned: 0 in 0.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.931s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278536805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f838347-ec74-4bcd-8be4-800de13bb208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d178f5e904b559bea3674d2801dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:24:59Z,use_quota=True,user_id='7641b87fa9d84da488b6794b41802e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Creating volume 9f838347-ec74-4bcd-8be4-800de13bb208 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ace50f1-68bb-4027-8b56-76febc84e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d04855-f308-49ee-98e7-ce1a0b3309aa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd8001-e7c6-4175-aa2c-c15b4e5bab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 1073741824 Nov 03 12:25:03 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Volume volume-05d04855-f308-49ee-98e7-ce1a0b3309aa (05d04855-f308-49ee-98e7-ce1a0b3309aa): created successfully Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd8001-e7c6-4175-aa2c-c15b4e5bab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (dec8fb0d-74d0-4bb1-95cb-aad2d3a2b0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:03 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:03 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (49e38dc7-2881-46a3-8ee0-762c6d5a254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e14fa-7101-478f-9cfe-5d8fc3ae3ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-429486aa-8082-49f5-805c-7efdf54cc0d2 tempest-CreateVolumesFromImageTest-402313878 None] Created volume successfully. Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e14fa-7101-478f-9cfe-5d8fc3ae3ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407963143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165ddfb0-0728-490c-b1d3-3bc16fe3f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:03Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ed79c1-8b4c-4bc9-87f4-ffd5400670e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ed79c1-8b4c-4bc9-87f4-ffd5400670e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c066f8c-077a-4821-b44e-5017abb0d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c066f8c-077a-4821-b44e-5017abb0d3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165ddfb0-0728-490c-b1d3-3bc16fe3f569', 'volume_name': 'volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631b517c-cc0e-4343-b80e-a45843f39c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631b517c-cc0e-4343-b80e-a45843f39c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccda126b-bfac-4d50-a358-92ccc12c7a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume 165ddfb0-0728-490c-b1d3-3bc16fe3f569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569', 'volume_size': 1} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:03 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Temporary image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 is fetched for user 443d985bac7f414ba9a2a0406408b9aa. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5aecbf-70fb-493a-b685-bfc245a7a6d8]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (99395532-8c9d-4319-a72d-25c715f4b8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12442abd-8a7d-4d72-baf4-bae067c90ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:03 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12442abd-8a7d-4d72-baf4-bae067c90ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525839130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc0bb88-2cce-4af9-81c7-5d31e1150b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:04Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:03 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9074ff2-419f-4dfd-8aa5-b7709ecc3d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9074ff2-419f-4dfd-8aa5-b7709ecc3d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe80421-0db9-4e44-851f-e5d5586cdaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe80421-0db9-4e44-851f-e5d5586cdaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc0bb88-2cce-4af9-81c7-5d31e1150b9f', 'volume_name': 'volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcdd009-36fd-46e8-b60d-5fce6f672c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcdd009-36fd-46e8-b60d-5fce6f672c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccc8d4-10b0-4d7d-91fc-f7d3665dff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume cfc0bb88-2cce-4af9-81c7-5d31e1150b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f', 'volume_size': 1} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 1073741824" returned: 0 in 0.774s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:04 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 Nov 03 12:25:04 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:04 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (e8e13e28-d5c8-4cc9-9ede-d846dc895ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8197f944-4a15-4b9f-9117-32e4b99f02e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8197f944-4a15-4b9f-9117-32e4b99f02e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732871727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dfdbb6-8853-4568-b255-b5d6a20e80e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:04Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa90b6-8be6-4385-bb86-bd779e3df1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa90b6-8be6-4385-bb86-bd779e3df1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3381ba7e-476d-4f3c-ab42-82d986f77e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3381ba7e-476d-4f3c-ab42-82d986f77e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dfdbb6-8853-4568-b255-b5d6a20e80e3', 'volume_name': 'volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d85e61-d5e1-4014-bb85-bb82ca3dde61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d85e61-d5e1-4014-bb85-bb82ca3dde61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f82aaa-f1c2-4143-b23d-9fc7f145d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume 39dfdbb6-8853-4568-b255-b5d6a20e80e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3', 'volume_size': 1} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:04 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:04 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:04 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053580450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d30a85-c429-463d-96ca-f00903eeda59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:02Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume e1d30a85-c429-463d-96ca-f00903eeda59 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11d52a5-0d53-4aa3-9fd3-8673e5447e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f838347-ec74-4bcd-8be4-800de13bb208', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee4041-662c-4c3f-8687-4a6ec124629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:04 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 1073741824 Nov 03 12:25:04 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Volume volume-9f838347-ec74-4bcd-8be4-800de13bb208 (9f838347-ec74-4bcd-8be4-800de13bb208): created successfully Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee4041-662c-4c3f-8687-4a6ec124629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Flow 'volume_create_manager' (5b49f534-b3db-43bd-adcd-b6b4e6e1b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-45d79164-641f-4fd2-92f1-489103316f9b tempest-CreateVolumesFromImageTest-402313878 None] Created volume successfully. Nov 03 12:25:04 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:04 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 1073741824" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:04 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 Nov 03 12:25:04 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-9f838347-ec74-4bcd-8be4-800de13bb208-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300182577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1eafb72-e1ba-4358-9b7e-0131b48c0459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:03Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume a1eafb72-e1ba-4358-9b7e-0131b48c0459 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8204f7-7243-4080-941f-ce6a402e3466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d30a85-c429-463d-96ca-f00903eeda59', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:05 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 1073741824 Nov 03 12:25:05 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8a783-4061-4e10-a98d-87e1f454afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-9f838347-ec74-4bcd-8be4-800de13bb208-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-e1d30a85-c429-463d-96ca-f00903eeda59 (e1d30a85-c429-463d-96ca-f00903eeda59): created successfully Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8a783-4061-4e10-a98d-87e1f454afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (ec64bac6-ae17-4578-83f7-1259c22f2f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-quobyte-9f838347-ec74-4bcd-8be4-800de13bb208" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-be083b92-72bd-4e4f-a0b4-f887060fbc8d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-9f838347-ec74-4bcd-8be4-800de13bb208" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc88dea-3588-4034-a74d-4ec2bacfeaf4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:05 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 Nov 03 12:25:05 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 1073741824" returned: 0 in 0.444s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:05 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 Nov 03 12:25:05 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:05 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208 Nov 03 12:25:05 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16364608-ae7b-4838-8037-b6c3a04214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6c0e50e3034f40a57909022a6d51b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:01Z,use_quota=True,user_id='df25ccf16f5f4237abf46ab9754dfeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Creating volume 16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277afd87-7d7d-4eeb-be9f-2ff1b2edc8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:05 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:05 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1073741824 Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3365a875-34c1-4ca9-b1c8-7962d4ac08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:05 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9f838347-ec74-4bcd-8be4-800de13bb208" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-9f838347-ec74-4bcd-8be4-800de13bb208" released by "delete_volume" :: held 0.686s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 (a1eafb72-e1ba-4358-9b7e-0131b48c0459): created successfully Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3365a875-34c1-4ca9-b1c8-7962d4ac08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (0f744965-6aa3-4450-bfb9-d69a57fb84e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b1cb4a73-8cd0-4b97-b791-519da20f868d tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Created reservations ['a9770d5e-9165-4a25-9ea8-8b1d2ba02dd9', '07b2f470-b221-47e0-b9c0-447b6ec33642', '879cf0ba-5521-466c-a79b-749569c14a73', 'b4c85bda-14d4-462a-a8a5-7aef7cab368a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:06 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-05d04855-f308-49ee-98e7-ce1a0b3309aa-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-05d04855-f308-49ee-98e7-ce1a0b3309aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-quobyte-05d04855-f308-49ee-98e7-ce1a0b3309aa" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:06 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-05d04855-f308-49ee-98e7-ce1a0b3309aa" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:06 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1073741824" returned: 0 in 0.544s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Deleted volume successfully. Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d4c6a-a9db-427e-884d-6ae887311307]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-06c40526-eb16-4ab4-8bad-91cbd4988107 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-9f838347-ec74-4bcd-8be4-800de13bb208-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da Nov 03 12:25:06 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:06 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa Nov 03 12:25:06 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:06 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.219s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407963143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165ddfb0-0728-490c-b1d3-3bc16fe3f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:03Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume 165ddfb0-0728-490c-b1d3-3bc16fe3f569 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 1073741824 Nov 03 12:25:06 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Attempting download of 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}])) to volume 16364608-ae7b-4838-8037-b6c3a04214da. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:25:06 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa Nov 03 12:25:06 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e345b82-dc8f-4b1c-acb8-493f34660c33]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:06 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy Nov 03 12:25:06 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-05d04855-f308-49ee-98e7-ce1a0b3309aa" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-05d04855-f308-49ee-98e7-ce1a0b3309aa" released by "delete_volume" :: held 0.725s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Created reservations ['f2e83b24-9f34-4c9b-8e64-a4bb9c48937d', 'f0fabfb8-2ffd-4bb5-86bd-353cf5e7a513', '15ab097a-929d-41da-ac8a-af805bfdf7c5', '08f191c9-e4c6-4307-a487-eba8d3f4aa5f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:07 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 1073741824" returned: 0 in 0.497s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:07 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy Nov 03 12:25:07 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 Nov 03 12:25:07 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-11e40e82-9ba8-45d1-9977-666e91ddb725-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-11e40e82-9ba8-45d1-9977-666e91ddb725-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:07 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy" returned: 1 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_o1dbe6xy' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-quobyte-11e40e82-9ba8-45d1-9977-666e91ddb725" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a0a508-d571-405d-94f4-61876a02ca5f]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Deleted volume successfully. Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-11e40e82-9ba8-45d1-9977-666e91ddb725" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-539c5c3e-694d-492f-b2dc-19f450754b3b tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-05d04855-f308-49ee-98e7-ce1a0b3309aa-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92825a-1ed2-4110-8a14-095d3a837664]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569" returned: 0 in 0.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525839130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc0bb88-2cce-4af9-81c7-5d31e1150b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:04Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume cfc0bb88-2cce-4af9-81c7-5d31e1150b9f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:07 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:07 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:07 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f 1073741824 Nov 03 12:25:07 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccda126b-bfac-4d50-a358-92ccc12c7a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1ef96b-5c9b-4405-9e45-d0f90cce28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 (165ddfb0-0728-490c-b1d3-3bc16fe3f569): created successfully Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1ef96b-5c9b-4405-9e45-d0f90cce28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:07 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 Nov 03 12:25:07 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (49e38dc7-2881-46a3-8ee0-762c6d5a254e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9d068c34-d482-4868-b1b1-f0e1ec9156ec tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:07 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725" returned: 0 in 0.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD Nov 03 12:25:08 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725 Nov 03 12:25:08 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f 1073741824" returned: 0 in 0.479s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f Nov 03 12:25:08 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 was raw, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:25:08 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-11e40e82-9ba8-45d1-9977-666e91ddb725" returned: 0 in 0.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-11e40e82-9ba8-45d1-9977-666e91ddb725" released by "delete_volume" :: held 0.736s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:08 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da Nov 03 12:25:08 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Created reservations ['f4be2ff5-3216-472b-87c6-46540a822391', 'e9bbfd8b-f272-4a60-a444-a4bcbac06b4c', 'e186daa0-fc0e-4774-ac6b-07e12e48f2a7', '31dc2af8-e202-4a32-a63d-281690f96957'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:08 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" returned: 0 in 0.269s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.175s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732871727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dfdbb6-8853-4568-b255-b5d6a20e80e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48abfe863144577adcf46421e88c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:04Z,use_quota=True,user_id='240651e6d7ea44089e09c9118fb0b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Creating volume 39dfdbb6-8853-4568-b255-b5d6a20e80e3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:08 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 1073741824 Nov 03 12:25:08 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccc8d4-10b0-4d7d-91fc-f7d3665dff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef904bf-bbb5-454d-ac8d-4d0eed131845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f (cfc0bb88-2cce-4af9-81c7-5d31e1150b9f): created successfully Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef904bf-bbb5-454d-ac8d-4d0eed131845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (99395532-8c9d-4319-a72d-25c715f4b8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-28b2504e-fcd8-4046-a5b2-503f80913c9e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-5f5829a8-a8a3-4f12-8366-d4a586a99132-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-5f5829a8-a8a3-4f12-8366-d4a586a99132-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-quobyte-5f5829a8-a8a3-4f12-8366-d4a586a99132" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-5f5829a8-a8a3-4f12-8366-d4a586a99132" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0d63b-fe0f-4b3f-90fc-d26644e44e54]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:08 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.441s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Deleted volume successfully. Nov 03 12:25:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-43139c0c-ab80-46b3-bcd4-cb152da06ef4 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-11e40e82-9ba8-45d1-9977-666e91ddb725-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:09 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 Nov 03 12:25:09 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da" returned: 0 in 0.767s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26a6114a-f83c-4cb4-bb0c-d69e207b75d2_mipp47fzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:09 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1G Nov 03 12:25:09 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 1073741824" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:09 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 Nov 03 12:25:09 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132" returned: 0 in 0.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:09 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132 Nov 03 12:25:09 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da 1G" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Downloaded image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}])) to volume 16364608-ae7b-4838-8037-b6c3a04214da successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Temporary image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 for user df25ccf16f5f4237abf46ab9754dfeec is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Marking volume 16364608-ae7b-4838-8037-b6c3a04214da as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Copying metadata from image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 to 16364608-ae7b-4838-8037-b6c3a04214da. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Creating volume glance metadata for volume 16364608-ae7b-4838-8037-b6c3a04214da backed by image 26a6114a-f83c-4cb4-bb0c-d69e207b75d2 with: {'image_id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '56518afe7a2f161f67473f7dbd7ed649', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:25:09 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3" returned: 0 in 0.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.948s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef52625d-7183-45bb-ac36-a6480cd411e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4667f846d24f4d818a3ee4e6d0486ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:02Z,use_quota=True,user_id='443d985bac7f414ba9a2a0406408b9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46eb9e23-779c-40fb-9fbb-af6761fa8c82),volume_type_id=46eb9e23-779c-40fb-9fbb-af6761fa8c82)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Creating volume ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:09 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1073741824 Nov 03 12:25:09 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f82aaa-f1c2-4143-b23d-9fc7f145d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeab8e0-1bc2-4175-b909-30798485aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774aea29-843f-44be-8143-e6f0464013f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16364608-ae7b-4838-8037-b6c3a04214da', 'volume_size': 1, 'image_id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56518afe7a2f161f67473f7dbd7ed649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f6c0e50e3034f40a57909022a6d51b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d1cf849d015d5865eb8964afa076fcbcac75266e5037dd5766ae121949bb8d8bcaeec6a1b34889a2a1744b5adcd4a49bcd6324f5568665482b00fdf5f832cc', 'id': '26a6114a-f83c-4cb4-bb0c-d69e207b75d2', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a6114a-f83c-4cb4-bb0c-d69e207b75d2/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ec3edc-204d-479f-9aae-b2d3eb6a6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Volume volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 (39dfdbb6-8853-4568-b255-b5d6a20e80e3): created successfully Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeab8e0-1bc2-4175-b909-30798485aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:09 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Flow 'volume_create_manager' (e8e13e28-d5c8-4cc9-9ede-d846dc895ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5f5829a8-a8a3-4f12-8366-d4a586a99132" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Volume volume-16364608-ae7b-4838-8037-b6c3a04214da (16364608-ae7b-4838-8037-b6c3a04214da): created successfully Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ec3edc-204d-479f-9aae-b2d3eb6a6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Flow 'volume_create_manager' (e69833b1-088d-4d90-a306-7915737fcb0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-5f5829a8-a8a3-4f12-8366-d4a586a99132" released by "delete_volume" :: held 0.872s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-79f1733b-bf6b-4627-9760-150d03d42596 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created volume successfully. Nov 03 12:25:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e50c8851-bd31-416b-b502-d4f50c3a8b33 tempest-VolumeImageDependencyTests-1698131099 None] Created volume successfully. Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Created reservations ['14909bd7-d52a-4d9d-b5d9-80261bd8a3f3', 'b8a3038d-14e5-4254-931f-726686f1d0f5', '30dd6bc7-5801-4ffa-8049-40399d326471', '9e5f88c4-59b3-47b7-80ea-70bd2d342474'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:09 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:09 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-4719c341-b305-46f8-9581-ee3665ae5b86-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-4719c341-b305-46f8-9581-ee3665ae5b86-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "cinder-quobyte-4719c341-b305-46f8-9581-ee3665ae5b86" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-4719c341-b305-46f8-9581-ee3665ae5b86" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.304s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27a67f-390e-4205-a6d8-e730fde47445]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-39dfdbb6-8853-4568-b255-b5d6a20e80e3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Deleted volume successfully. Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1073741824" returned: 0 in 0.589s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce28905e-cf6e-4299-bce8-991da251d1d6 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-5f5829a8-a8a3-4f12-8366-d4a586a99132-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-39dfdbb6-8853-4568-b255-b5d6a20e80e3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-39dfdbb6-8853-4568-b255-b5d6a20e80e3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:10 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 Nov 03 12:25:10 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-39dfdbb6-8853-4568-b255-b5d6a20e80e3" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 Nov 03 12:25:10 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c22734-b817-46e3-aaef-e7955504796b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Acquiring lock "cinder-16364608-ae7b-4838-8037-b6c3a04214da-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "cinder-16364608-ae7b-4838-8037-b6c3a04214da-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 Nov 03 12:25:10 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Acquiring lock "cinder-quobyte-16364608-ae7b-4838-8037-b6c3a04214da" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "cinder-quobyte-16364608-ae7b-4838-8037-b6c3a04214da" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[370fed0c-8efe-4598-b9c7-d9d08dccdeda]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:10 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86 Nov 03 12:25:10 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Attempting download of c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}])) to volume ef52625d-7183-45bb-ac36-a6480cd411e4. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d68db28-0c69-4980-bb0b-7b1a3aedec50]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da Nov 03 12:25:10 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3" returned: 0 in 0.484s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:10 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3 Nov 03 12:25:10 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni Nov 03 12:25:10 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:10 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4719c341-b305-46f8-9581-ee3665ae5b86" returned: 0 in 0.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-quobyte-4719c341-b305-46f8-9581-ee3665ae5b86" released by "delete_volume" :: held 0.836s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Created reservations ['1f7e9a68-a815-4b98-8838-ce059e69f3c0', '3d0c5fe1-9e74-461b-bc21-c009b5f41e5a', 'dfff7085-da3e-4097-b744-da872f31b667', '8f708493-23b2-4126-bcce-d82e78ec7c57'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:10 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da Nov 03 12:25:11 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni" returned: 0 in 0.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:11 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-39dfdbb6-8853-4568-b255-b5d6a20e80e3" returned: 0 in 0.330s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-39dfdbb6-8853-4568-b255-b5d6a20e80e3" released by "delete_volume" :: held 0.883s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:11 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni Nov 03 12:25:11 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['9236f104-e2b4-4a87-a4c2-33e30e61f209', '329f1eb9-950a-46fa-b2d6-0e3ddc9837d6', '43cfb7f1-c23b-4db4-a14a-d1634a549526', '256d881d-f673-439d-a150-f1917ca6fb26'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.309s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:11 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Deleted volume successfully. Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cc4b4c2f-1245-4ef5-a599-8c40d3459115 tempest-CreateVolumesFromImageTest-402313878 None] Lock "cinder-4719c341-b305-46f8-9581-ee3665ae5b86-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:11 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-16364608-ae7b-4838-8037-b6c3a04214da" returned: 0 in 0.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "cinder-quobyte-16364608-ae7b-4838-8037-b6c3a04214da" released by "delete_volume" :: held 0.971s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni" returned: 1 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_1qk6etni' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc53eb1-af79-4078-9a70-746f2a216c94]: (4, 'raw') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Created reservations ['53a13af2-98bc-4274-aaad-b8a0f024507c', 'ad3f2481-47f7-43b4-b950-14cf6f25d35a', 'd2186bfc-ef92-43da-aea4-695685fd15bf', 'f8bf30bd-52b9-406d-990b-f23bfa123ae2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:11 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:11 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.373s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bc85b15-0c5f-4d66-a7e4-aca693d0348e tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-39dfdbb6-8853-4568-b255-b5d6a20e80e3-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:11 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:11 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:11 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:12 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:12 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD Nov 03 12:25:12 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Deleted volume successfully. Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2e2c4fda-1c78-4463-b978-a2161135024b tempest-VolumeImageDependencyTests-1698131099 None] Lock "cinder-16364608-ae7b-4838-8037-b6c3a04214da-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:12 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 was raw, converting to qcow2 {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:12 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 Nov 03 12:25:12 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a25100-4f94-40ea-948e-c88d3bed7e67]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:12 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f Nov 03 12:25:12 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:12 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4" returned: 0 in 0.613s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4a4c8ef-9412-4fe8-8dca-c0cb67894b83_648gck6odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:25:12 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:12 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1G Nov 03 12:25:12 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:12 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" returned: 0 in 0.445s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:12 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f Nov 03 12:25:12 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:13 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f" released by "delete_volume" :: held 0.761s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:13 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['00e922fd-fa41-4aa7-8fde-f5981c5dd180', '8ef94e9b-dce2-4e27-a1c5-7b068c6a1870', 'dd353327-8ab3-4ccf-91c4-a802ffe4c756', 'e2483ca9-29c3-484a-ba59-6ae35cab97ab'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 1G" returned: 0 in 0.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Downloaded image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}])) to volume ef52625d-7183-45bb-ac36-a6480cd411e4 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Temporary image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 for user 443d985bac7f414ba9a2a0406408b9aa is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Marking volume ef52625d-7183-45bb-ac36-a6480cd411e4 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Copying metadata from image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 to ef52625d-7183-45bb-ac36-a6480cd411e4. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Creating volume glance metadata for volume ef52625d-7183-45bb-ac36-a6480cd411e4 backed by image c4a4c8ef-9412-4fe8-8dca-c0cb67894b83 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '37afd6cfcd9eb134f6246646c49a702f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:13 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:13 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62011b0-11f5-4f3a-a11b-3e79cf07ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef52625d-7183-45bb-ac36-a6480cd411e4', 'volume_size': 1, 'image_id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37afd6cfcd9eb134f6246646c49a702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4667f846d24f4d818a3ee4e6d0486ad6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b80290de353506788455b4e0a7ef3400eb31160bc61b530a9ec50bd6d42fc652cddc8c583d5bbed79a1ddb2d7deae88cc2ca5d223a8779d91e81284bd71fd9d5', 'id': 'c4a4c8ef-9412-4fe8-8dca-c0cb67894b83', 'created_at': datetime.datetime(2026, 11, 3, 11, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4a4c8ef-9412-4fe8-8dca-c0cb67894b83/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b89bf6-4aef-4e28-a214-795cc4d7c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Volume volume-ef52625d-7183-45bb-ac36-a6480cd411e4 (ef52625d-7183-45bb-ac36-a6480cd411e4): created successfully Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b89bf6-4aef-4e28-a214-795cc4d7c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Flow 'volume_create_manager' (29f5da30-369c-472b-a374-128227c32240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-146691cc-b5bf-4564-937b-8c0a2daf11ae tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Created volume successfully. Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-165ddfb0-0728-490c-b1d3-3bc16fe3f569-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-165ddfb0-0728-490c-b1d3-3bc16fe3f569-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-165ddfb0-0728-490c-b1d3-3bc16fe3f569" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-165ddfb0-0728-490c-b1d3-3bc16fe3f569" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c12f0-abe5-4596-b967-9095bb6936c5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:13 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eadde42b-ea09-43f5-b1d5-0101cb04d40b tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-cfc0bb88-2cce-4af9-81c7-5d31e1150b9f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Acquiring lock "cinder-ef52625d-7183-45bb-ac36-a6480cd411e4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "cinder-ef52625d-7183-45bb-ac36-a6480cd411e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Acquiring lock "cinder-quobyte-ef52625d-7183-45bb-ac36-a6480cd411e4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:14 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 Nov 03 12:25:14 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "cinder-quobyte-ef52625d-7183-45bb-ac36-a6480cd411e4" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c34e80-8f44-41c2-9a35-88478853ad02]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:14 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 Nov 03 12:25:14 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:14 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569" returned: 0 in 0.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:14 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569 Nov 03 12:25:14 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:14 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4" returned: 0 in 0.453s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:14 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4 Nov 03 12:25:14 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:14 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-165ddfb0-0728-490c-b1d3-3bc16fe3f569" returned: 0 in 0.345s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-165ddfb0-0728-490c-b1d3-3bc16fe3f569" released by "delete_volume" :: held 1.057s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:14 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ef52625d-7183-45bb-ac36-a6480cd411e4" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['c577e749-9210-4d61-b139-7289c7ccaecb', 'a52abbb8-b4f5-429f-b496-fd88f9314ace', 'b5dfd525-e992-47c2-b1f5-a00602990ae2', 'dd335eb3-663e-49ee-9f88-53948961b733'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "cinder-quobyte-ef52625d-7183-45bb-ac36-a6480cd411e4" released by "delete_volume" :: held 0.869s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Created reservations ['4b2296f3-8b35-4e28-8bde-f4452920617b', '32cf06bc-d4ca-4204-81f9-cb8ac5bb6e55', '92aa7368-6de7-49d0-8c70-b14e133a777c', '8a3d42ac-c41f-45be-b7ba-7ac6c02e3071'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:15 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:15 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (6ccd1d9a-2cfa-47e5-9999-424ba5f71333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37a886c-37ec-40e0-92ba-e3ca269eb4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37a886c-37ec-40e0-92ba-e3ca269eb4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245014261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:15Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab256f54-cb02-4f84-8d79-a560a23c3e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab256f54-cb02-4f84-8d79-a560a23c3e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c7f0d0-db3a-4773-95d6-49b1dfa8e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c7f0d0-db3a-4773-95d6-49b1dfa8e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6', 'volume_name': 'volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b334b2-5af1-4a56-9254-8eb3840befc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b334b2-5af1-4a56-9254-8eb3840befc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e964abb-ef54-4db8-ba3b-528c5e5c3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume 3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6', 'volume_size': 1} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245014261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:15Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume 3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:15 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:15 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 1073741824 Nov 03 12:25:15 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:15 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:15 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:15 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e820fb5-c41f-4065-a304-8580e9157b53 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-165ddfb0-0728-490c-b1d3-3bc16fe3f569-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:15 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.335s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Deleted volume successfully. Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d2c3f56-b64b-40f1-9af5-356b4c88078a tempest-VolumeAndVolumeTypeFromImageTest-1436359721 None] Lock "cinder-ef52625d-7183-45bb-ac36-a6480cd411e4-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:15 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 1073741824" returned: 0 in 0.560s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:15 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 Nov 03 12:25:15 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-a1eafb72-e1ba-4358-9b7e-0131b48c0459-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-a1eafb72-e1ba-4358-9b7e-0131b48c0459-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-a1eafb72-e1ba-4358-9b7e-0131b48c0459" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-a1eafb72-e1ba-4358-9b7e-0131b48c0459" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234adda-dc08-4057-861f-0e2792373089]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:16 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e964abb-ef54-4db8-ba3b-528c5e5c3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e10b55-31e9-47e7-98da-e052a86627fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 (3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6): created successfully Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e10b55-31e9-47e7-98da-e052a86627fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (6ccd1d9a-2cfa-47e5-9999-424ba5f71333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0c2cdaed-7518-4a97-842a-033a3c37f7a9 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:16 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 Nov 03 12:25:16 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:16 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459" returned: 0 in 0.491s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:16 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459 Nov 03 12:25:16 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:17 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1eafb72-e1ba-4358-9b7e-0131b48c0459" returned: 0 in 0.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-a1eafb72-e1ba-4358-9b7e-0131b48c0459" released by "delete_volume" :: held 0.875s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['9a358d3f-8ed3-4abf-a6da-2eafb0ec4845', '78e9bdc2-fabd-420c-8d7e-99d03e9151a9', 'e3686512-30ba-4f04-9f99-9bd1dea7b4c4', 'f533b1e1-782c-4475-b043-7fe7de6c090a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:17 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:17 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-e1d30a85-c429-463d-96ca-f00903eeda59-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-e1d30a85-c429-463d-96ca-f00903eeda59-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-e1d30a85-c429-463d-96ca-f00903eeda59" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-e1d30a85-c429-463d-96ca-f00903eeda59" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ca12c-291e-4720-a18b-3a7ecb8c6323]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:17 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Flow 'volume_create_manager' (c41bfae3-270a-4a4b-b376-7245459f8f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326f1e56-23db-4dca-8040-cecfb89a6566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.431s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326f1e56-23db-4dca-8040-cecfb89a6566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad28289b-767c-499d-abd9-04bf62ab5b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac958e9feb640bcad7b9fb6564ad8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:17Z,use_quota=True,user_id='f6b9c8786ed74bcd84a888cb6596dd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1df5d-83ec-45f5-8967-67d28961c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1df5d-83ec-45f5-8967-67d28961c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e5f3f3-b25f-41eb-8421-8ac2fed06652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e5f3f3-b25f-41eb-8421-8ac2fed06652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad28289b-767c-499d-abd9-04bf62ab5b73', 'volume_name': 'volume-ad28289b-767c-499d-abd9-04bf62ab5b73', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfd9e32-dffa-44c8-887d-06ad2dd87c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:17 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfd9e32-dffa-44c8-887d-06ad2dd87c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:17 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77d6d96-432a-406b-b524-d2b6c23bd917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Volume ad28289b-767c-499d-abd9-04bf62ab5b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad28289b-767c-499d-abd9-04bf62ab5b73', 'volume_size': 1} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad28289b-767c-499d-abd9-04bf62ab5b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac958e9feb640bcad7b9fb6564ad8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:17Z,use_quota=True,user_id='f6b9c8786ed74bcd84a888cb6596dd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Creating volume ad28289b-767c-499d-abd9-04bf62ab5b73 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:17 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 1073741824 Nov 03 12:25:17 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6806d877-c482-4b82-95d4-ab3ff5255a2c tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-a1eafb72-e1ba-4358-9b7e-0131b48c0459-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:18 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59" returned: 0 in 0.612s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:18 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59 Nov 03 12:25:18 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:18 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 1073741824" returned: 0 in 0.661s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:18 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e1d30a85-c429-463d-96ca-f00903eeda59" returned: 0 in 0.335s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-e1d30a85-c429-463d-96ca-f00903eeda59" released by "delete_volume" :: held 1.033s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:18 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 Nov 03 12:25:18 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['3c7b4af6-4440-447d-8d27-ef710ff9f12d', '12605d2c-880a-4261-9d3c-cccc3fea5da9', '82cb36f0-947c-4851-8106-0a6dd99c9513', '03f8a421-2cd8-4a03-ad6f-5c1ee064933a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:18 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:18 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:18 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73" returned: 0 in 0.289s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.944s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77d6d96-432a-406b-b524-d2b6c23bd917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad28289b-767c-499d-abd9-04bf62ab5b73', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0e1926-7ed2-41d8-a672-c575ab4cf457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating offline snapshot a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a of volume 3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:25:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Volume volume-ad28289b-767c-499d-abd9-04bf62ab5b73 (ad28289b-767c-499d-abd9-04bf62ab5b73): created successfully Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0e1926-7ed2-41d8-a672-c575ab4cf457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Flow 'volume_create_manager' (c41bfae3-270a-4a4b-b376-7245459f8f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba17ad1e-3121-4d9a-85ac-a9a2d2ab8310]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2ef1ba04-565c-4070-a545-1ea4a0606899 tempest-CinderUnicodeTest-883409122 None] Created volume successfully. Nov 03 12:25:18 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.286s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6764e1af-e6ed-478e-93ca-bde8cb121079 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-e1d30a85-c429-463d-96ca-f00903eeda59-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:19 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 Nov 03 12:25:19 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:19 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" returned: 0 in 0.409s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:19 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a 1G Nov 03 12:25:19 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-2b14b0c4-327e-489f-ab79-97f66cb24ff0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-2b14b0c4-327e-489f-ab79-97f66cb24ff0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "cinder-quobyte-2b14b0c4-327e-489f-ab79-97f66cb24ff0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-2b14b0c4-327e-489f-ab79-97f66cb24ff0" acquired by "delete_volume" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386d305-1fd3-4b39-8f8e-e75f3f28728f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:19 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a 1G" returned: 0 in 0.619s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:19 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 Nov 03 12:25:19 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a Nov 03 12:25:19 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Flow 'volume_create_manager' (6655003e-ccd9-4454-91a6-5a032ebd8ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46515da-dd9a-4aaa-917e-9aef51c52310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46515da-dd9a-4aaa-917e-9aef51c52310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1617812237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958659bb-704d-469b-b968-35f9390a8b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac958e9feb640bcad7b9fb6564ad8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:20Z,use_quota=True,user_id='f6b9c8786ed74bcd84a888cb6596dd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8cdc3b-5619-4110-b3c2-7c6a519ba21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8cdc3b-5619-4110-b3c2-7c6a519ba21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ee9a1-b609-4b9a-ad02-d5da549e6f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ee9a1-b609-4b9a-ad02-d5da549e6f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958659bb-704d-469b-b968-35f9390a8b38', 'volume_name': 'volume-958659bb-704d-469b-b968-35f9390a8b38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9edf13-fd4d-4850-91c8-81e24fba7bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9edf13-fd4d-4850-91c8-81e24fba7bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2013507b-c0c8-4606-9ab9-f603d6fe27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Volume 958659bb-704d-469b-b968-35f9390a8b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958659bb-704d-469b-b968-35f9390a8b38', 'volume_size': 1} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:20 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0" returned: 0 in 0.501s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:20 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" returned: 0 in 0.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:20 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a is being set with open permissions: ugo+rw Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:20 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0 Nov 03 12:25:20 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a Nov 03 12:25:20 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2b14b0c4-327e-489f-ab79-97f66cb24ff0" returned: 0 in 0.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-quobyte-2b14b0c4-327e-489f-ab79-97f66cb24ff0" released by "delete_volume" :: held 0.835s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:20 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Created reservations ['7ba07c76-b407-4492-b92f-3e1fe62459d7', 'b8e000e7-8795-435e-ae23-ba7a4b0ec5cc', '7e6be49e-1c85-40bc-b668-84d231fbe0f0', '2a64d21d-bcb9-42d7-8621-b00eb2cc97d8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:20 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info Nov 03 12:25:20 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:20 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:20 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:20 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info" returned: 0 in 0.317s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:20 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info is being set with open permissions: ugo+rw Nov 03 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:21 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info Nov 03 12:25:21 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:21 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.338s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Deleted volume successfully. Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8469ebd8-cfa6-4527-906e-54b5cd6d2e94 tempest-CreateVolumesFromSourceVolumeTest-772144920 None] Lock "cinder-2b14b0c4-327e-489f-ab79-97f66cb24ff0-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:21 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.info" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1617812237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958659bb-704d-469b-b968-35f9390a8b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac958e9feb640bcad7b9fb6564ad8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:20Z,use_quota=True,user_id='f6b9c8786ed74bcd84a888cb6596dd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Creating volume 958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:21 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 1073741824 Nov 03 12:25:21 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8966a3b0-2dae-48e3-aef0-b5b2a437ea73 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Create snapshot completed successfully Nov 03 12:25:21 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 1073741824" returned: 0 in 0.555s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:21 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 Nov 03 12:25:21 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Flow 'volume_create_manager' (4e887f24-1fa2-4f11-9ca7-25a6d70a84e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0039bee-247d-458e-9f83-875b80e7bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0039bee-247d-458e-9f83-875b80e7bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33167386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a720bf07-7191-48fb-960e-6d0f001045b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7125dc913a0945398ee617e5dd46b5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:22Z,use_quota=True,user_id='dfb46a8b7cf64cdcb6010063ca1334e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb14ca-dc70-4dd0-840b-2f4fd625dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb14ca-dc70-4dd0-840b-2f4fd625dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e077420d-2c53-48f3-b2a3-c9e8052a65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e077420d-2c53-48f3-b2a3-c9e8052a65c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a720bf07-7191-48fb-960e-6d0f001045b3', 'volume_name': 'volume-a720bf07-7191-48fb-960e-6d0f001045b3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145d8075-60cc-4f9d-9395-192b0363c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145d8075-60cc-4f9d-9395-192b0363c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc86bc-6791-4ce6-850b-34bf6af9c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Volume a720bf07-7191-48fb-960e-6d0f001045b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a720bf07-7191-48fb-960e-6d0f001045b3', 'volume_size': 1} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:22 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38" returned: 0 in 0.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33167386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a720bf07-7191-48fb-960e-6d0f001045b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7125dc913a0945398ee617e5dd46b5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:22Z,use_quota=True,user_id='dfb46a8b7cf64cdcb6010063ca1334e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Creating volume a720bf07-7191-48fb-960e-6d0f001045b3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2013507b-c0c8-4606-9ab9-f603d6fe27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958659bb-704d-469b-b968-35f9390a8b38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 1073741824 Nov 03 12:25:22 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd74b159-051c-403e-ab84-e88b02d3b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Volume volume-958659bb-704d-469b-b968-35f9390a8b38 (958659bb-704d-469b-b968-35f9390a8b38): created successfully Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd74b159-051c-403e-ab84-e88b02d3b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Flow 'volume_create_manager' (6655003e-ccd9-4454-91a6-5a032ebd8ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-81922d39-5abd-41b4-990f-ccb0b456a2be tempest-CinderUnicodeTest-883409122 None] Created volume successfully. Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (7b454608-1e87-4a42-b397-73087eef38bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3dd644-0e25-4955-b421-8f9ee2add7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3dd644-0e25-4955-b421-8f9ee2add7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-987085868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395247d9-f9c3-477a-8bb6-de3939382360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:23Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2810317-816f-4cad-88ac-b35ea0ef3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2810317-816f-4cad-88ac-b35ea0ef3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2441ce8f-778f-4a0a-a5f2-cee38b913477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2441ce8f-778f-4a0a-a5f2-cee38b913477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395247d9-f9c3-477a-8bb6-de3939382360', 'volume_name': 'volume-395247d9-f9c3-477a-8bb6-de3939382360', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5246cda7-883f-439c-b139-4516df1a8c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5246cda7-883f-439c-b139-4516df1a8c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68972d0c-b144-407c-8815-17e27d50e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume 395247d9-f9c3-477a-8bb6-de3939382360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395247d9-f9c3-477a-8bb6-de3939382360', 'volume_size': 1} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:22 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 1073741824" returned: 0 in 0.620s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:23 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 Nov 03 12:25:23 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (c0764145-0a2c-4cd3-8d72-f47b746417bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5ff9e9-091e-4d3b-b740-38cbc92d758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5ff9e9-091e-4d3b-b740-38cbc92d758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466195260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cde1f2-5b61-4153-969b-56753b2e5a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:23Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad825d86-d910-4aec-b213-9c43418bdb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad825d86-d910-4aec-b213-9c43418bdb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2484d1c-d3fa-409c-a963-60b6265bca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2484d1c-d3fa-409c-a963-60b6265bca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cde1f2-5b61-4153-969b-56753b2e5a69', 'volume_name': 'volume-a1cde1f2-5b61-4153-969b-56753b2e5a69', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed6032-6659-4ffc-a93e-0abe47529518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed6032-6659-4ffc-a93e-0abe47529518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb08d40-f638-49a6-9db1-bafd8ff16640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume a1cde1f2-5b61-4153-969b-56753b2e5a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cde1f2-5b61-4153-969b-56753b2e5a69', 'volume_size': 1} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:23 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3" returned: 0 in 0.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-987085868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395247d9-f9c3-477a-8bb6-de3939382360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:23Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume 395247d9-f9c3-477a-8bb6-de3939382360 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc86bc-6791-4ce6-850b-34bf6af9c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a720bf07-7191-48fb-960e-6d0f001045b3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215b576a-de51-4a7e-9590-b6490ed3abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 1073741824 Nov 03 12:25:23 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Volume volume-a720bf07-7191-48fb-960e-6d0f001045b3 (a720bf07-7191-48fb-960e-6d0f001045b3): created successfully Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215b576a-de51-4a7e-9590-b6490ed3abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Flow 'volume_create_manager' (4e887f24-1fa2-4f11-9ca7-25a6d70a84e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fad052ca-1050-44a0-963f-7733d12dfd8a tempest-ProjectReaderTests-1959844795 None] Created volume successfully. Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (5a3a3cb1-9d29-4932-bae6-e8dedc98d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde1cd5-2d01-40d9-8557-108fb9a8e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde1cd5-2d01-40d9-8557-108fb9a8e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683641616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=facccedb-370b-4b65-94b0-22b321eda84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:24Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a76995c-a8c8-455b-8582-bc5caab1df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a76995c-a8c8-455b-8582-bc5caab1df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f056915-1fdc-4720-8752-1b981bed9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f056915-1fdc-4720-8752-1b981bed9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'facccedb-370b-4b65-94b0-22b321eda84f', 'volume_name': 'volume-facccedb-370b-4b65-94b0-22b321eda84f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fde3da0-194f-4cb5-a9e0-dc2d7d66dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fde3da0-194f-4cb5-a9e0-dc2d7d66dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080e39f6-a6a1-4f3e-bf3e-2f37e276e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume facccedb-370b-4b65-94b0-22b321eda84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-facccedb-370b-4b65-94b0-22b321eda84f', 'volume_size': 1} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:24 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 1073741824" returned: 0 in 0.672s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (13462b35-8e9f-4a53-a752-e62be84e08ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0719152a-ab3f-410f-84df-8fe64a27f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:24 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:24 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0719152a-ab3f-410f-84df-8fe64a27f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535219994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bab708-d35c-4192-bc08-3e0a63ac002c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:24Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97f5425-4550-4e23-9700-9ce809ae8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 Nov 03 12:25:24 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97f5425-4550-4e23-9700-9ce809ae8734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136c4ec-0d9c-4e12-969f-376314e41e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136c4ec-0d9c-4e12-969f-376314e41e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bab708-d35c-4192-bc08-3e0a63ac002c', 'volume_name': 'volume-c7bab708-d35c-4192-bc08-3e0a63ac002c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afa07c0-4cf2-4f7b-9990-94cafdd2c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afa07c0-4cf2-4f7b-9990-94cafdd2c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee41f985-0ff6-4788-ace1-4255438c86c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume c7bab708-d35c-4192-bc08-3e0a63ac002c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bab708-d35c-4192-bc08-3e0a63ac002c', 'volume_size': 1} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:24 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.302s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:25:24 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360" returned: 0 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466195260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cde1f2-5b61-4153-969b-56753b2e5a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:23Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume a1cde1f2-5b61-4153-969b-56753b2e5a69 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:24 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 1073741824 Nov 03 12:25:24 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68972d0c-b144-407c-8815-17e27d50e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395247d9-f9c3-477a-8bb6-de3939382360', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb8c7b-d305-482a-99cb-1557d86a6d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-395247d9-f9c3-477a-8bb6-de3939382360 (395247d9-f9c3-477a-8bb6-de3939382360): created successfully Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb8c7b-d305-482a-99cb-1557d86a6d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (7b454608-1e87-4a42-b397-73087eef38bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d7f071aa-6e9c-4b01-ac9f-5fe5afe84fbd tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Acquiring lock "cinder-a720bf07-7191-48fb-960e-6d0f001045b3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "cinder-a720bf07-7191-48fb-960e-6d0f001045b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Acquiring lock "cinder-quobyte-a720bf07-7191-48fb-960e-6d0f001045b3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (1fce7c9d-b092-4c22-944f-4dd48ba5198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3701883f-da18-4bb4-ae08-03a228b73a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3701883f-da18-4bb4-ae08-03a228b73a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934024061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a10d82-916e-4769-891a-e1add0b0a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:25Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e2a1f-f09d-42bd-817e-39b8614ad7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e2a1f-f09d-42bd-817e-39b8614ad7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2e0eaf-0bc0-4b69-a457-b5a6e053f712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2e0eaf-0bc0-4b69-a457-b5a6e053f712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a10d82-916e-4769-891a-e1add0b0a5a6', 'volume_name': 'volume-54a10d82-916e-4769-891a-e1add0b0a5a6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e0159b-742c-4463-bca8-9ba389251988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e0159b-742c-4463-bca8-9ba389251988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b1fb3-c61f-46a1-a6ae-d277b94c85d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume 54a10d82-916e-4769-891a-e1add0b0a5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a10d82-916e-4769-891a-e1add0b0a5a6', 'volume_size': 1} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "cinder-quobyte-a720bf07-7191-48fb-960e-6d0f001045b3" acquired by "delete_volume" :: waited 0.104s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Flow 'volume_create_manager' (6744056b-3192-4bd1-921f-f5bb4df7e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c330b33-f505-4d09-a1f9-735d11699231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23f165-d2f9-4d2b-9aa2-c156c513c87f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c330b33-f505-4d09-a1f9-735d11699231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2121733532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccf15a5-9206-4b41-931d-38d7f233ccfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2837e14f14a44856ba0f050741571837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:25Z,use_quota=True,user_id='959a684bd25f4c27a893ad55cb7948fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8893de9-a125-4a9d-8d17-18ae7c647556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8893de9-a125-4a9d-8d17-18ae7c647556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600872db-e8b7-44a3-aef4-7de342be1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600872db-e8b7-44a3-aef4-7de342be1159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ccf15a5-9206-4b41-931d-38d7f233ccfc', 'volume_name': 'volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c217f4-a202-4c38-a177-01903fb3c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c217f4-a202-4c38-a177-01903fb3c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ef9f5-335d-43e0-aaf6-3a3ca33a4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Volume 4ccf15a5-9206-4b41-931d-38d7f233ccfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc', 'volume_size': 1} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:25 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 1073741824" returned: 0 in 0.524s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:25 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:25 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 Nov 03 12:25:25 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:25 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:25 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683641616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=facccedb-370b-4b65-94b0-22b321eda84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:24Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume facccedb-370b-4b65-94b0-22b321eda84f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:25 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3 Nov 03 12:25:25 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb08d40-f638-49a6-9db1-bafd8ff16640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cde1f2-5b61-4153-969b-56753b2e5a69', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f 1073741824 Nov 03 12:25:25 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0b4773-efd8-4ca5-8130-03dd8668077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 (a1cde1f2-5b61-4153-969b-56753b2e5a69): created successfully Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0b4773-efd8-4ca5-8130-03dd8668077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (c0764145-0a2c-4cd3-8d72-f47b746417bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5678ae7c-9f98-4e80-924e-7349263cdae3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:25 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a720bf07-7191-48fb-960e-6d0f001045b3" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "cinder-quobyte-a720bf07-7191-48fb-960e-6d0f001045b3" released by "delete_volume" :: held 0.752s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Created reservations ['acf1b3b6-c0d9-4c64-9784-e52e051f22f0', '3a302285-3e85-4359-b0cb-75520869d6fd', 'b2e06c4e-fd07-4998-b381-963b4e93ebc7', 'b2460246-732b-439b-9f2e-73e1d906f9cc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:25 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:25 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f 1073741824" returned: 0 in 0.468s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:25 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f Nov 03 12:25:25 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:26 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.258s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Deleted volume successfully. Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-75e6d2db-49a6-484f-aef8-d2008b0744ff tempest-ProjectReaderTests-1959844795 None] Lock "cinder-a720bf07-7191-48fb-960e-6d0f001045b3-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:26 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.353s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080e39f6-a6a1-4f3e-bf3e-2f37e276e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-facccedb-370b-4b65-94b0-22b321eda84f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4549bee7-76dc-4d9a-862c-46ed59d21b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Creating offline snapshot f08d5fa1-84f0-4afc-b1d5-5043924a69e8 of volume 958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-facccedb-370b-4b65-94b0-22b321eda84f (facccedb-370b-4b65-94b0-22b321eda84f): created successfully Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4549bee7-76dc-4d9a-862c-46ed59d21b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (5a3a3cb1-9d29-4932-bae6-e8dedc98d68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e168e-fd0e-4ddb-a37f-585bfba3db39]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-412b5781-c185-40f5-9a6e-43b96c161051 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:26 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 Nov 03 12:25:26 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Flow 'volume_create_manager' (0c5d7438-b22d-4e3d-823e-0c0415f40fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc289b4b-0831-49fb-a5ef-3eec92a15ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc289b4b-0831-49fb-a5ef-3eec92a15ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485764571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7125dc913a0945398ee617e5dd46b5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:26Z,use_quota=True,user_id='dfb46a8b7cf64cdcb6010063ca1334e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaac7a7-0d5d-4954-ac84-57a9f2cc15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaac7a7-0d5d-4954-ac84-57a9f2cc15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1770a1ec-22b2-4e67-a4e1-ecf8aa1811d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1770a1ec-22b2-4e67-a4e1-ecf8aa1811d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488', 'volume_name': 'volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbc873-3db1-4db0-b9f3-18654a16d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbc873-3db1-4db0-b9f3-18654a16d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cb239a-d03a-4cf9-8495-635af7368abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Volume c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488', 'volume_size': 1} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:26 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38" returned: 0 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:26 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 1G Nov 03 12:25:26 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:27 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 1G" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958659bb-704d-469b-b968-35f9390a8b38 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:27 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958659bb-704d-469b-b968-35f9390a8b38 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 Nov 03 12:25:27 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:27 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958659bb-704d-469b-b968-35f9390a8b38 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 is being set with open permissions: ugo+rw Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:27 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 Nov 03 12:25:27 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:27 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:27 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info Nov 03 12:25:27 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:27 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info is being set with open permissions: ugo+rw Nov 03 12:25:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:27 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info Nov 03 12:25:27 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:28 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.info" returned: 0 in 0.234s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.816s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535219994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bab708-d35c-4192-bc08-3e0a63ac002c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:24Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume c7bab708-d35c-4192-bc08-3e0a63ac002c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:28 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c 1073741824 Nov 03 12:25:28 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1b8c322f-4377-4a05-a6f5-0a401cec3d0f tempest-CinderUnicodeTest-883409122 None] Create snapshot completed successfully Nov 03 12:25:28 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c 1073741824" returned: 0 in 0.430s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:28 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c Nov 03 12:25:28 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:28 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.864s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934024061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a10d82-916e-4769-891a-e1add0b0a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb0740aba649bcb92c1f9a89e70139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:25Z,use_quota=True,user_id='e56f0a7781e24ed4a6251162c3ac65e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Creating volume 54a10d82-916e-4769-891a-e1add0b0a5a6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee41f985-0ff6-4788-ace1-4255438c86c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bab708-d35c-4192-bc08-3e0a63ac002c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:28 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 1073741824 Nov 03 12:25:28 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65be438-7dd5-498a-8a78-8b789ded1c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-c7bab708-d35c-4192-bc08-3e0a63ac002c (c7bab708-d35c-4192-bc08-3e0a63ac002c): created successfully Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65be438-7dd5-498a-8a78-8b789ded1c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (13462b35-8e9f-4a53-a752-e62be84e08ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8d08f8a7-2fed-43cc-8ccc-68a522aa99d5 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-f08d5fa1-84f0-4afc-b1d5-5043924a69e8-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-f08d5fa1-84f0-4afc-b1d5-5043924a69e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-quobyte-f08d5fa1-84f0-4afc-b1d5-5043924a69e8" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-f08d5fa1-84f0-4afc-b1d5-5043924a69e8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Deleting offline snapshot f08d5fa1-84f0-4afc-b1d5-5043924a69e8 of volume 958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] snapshot_file for this snap is: volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc593a73-854c-4af0-a06c-b1e93473cfed]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:29 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 Nov 03 12:25:29 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:29 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 1073741824" returned: 0 in 0.477s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:29 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 Nov 03 12:25:29 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:29 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8" returned: 0 in 0.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958659bb-704d-469b-b968-35f9390a8b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:25:29 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27dcf0b-79cf-4f1c-be65-31329df061c4]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.541s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2121733532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccf15a5-9206-4b41-931d-38d7f233ccfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2837e14f14a44856ba0f050741571837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:25Z,use_quota=True,user_id='959a684bd25f4c27a893ad55cb7948fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Creating volume 4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:29 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc 1073741824 Nov 03 12:25:29 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b1fb3-c61f-46a1-a6ae-d277b94c85d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a10d82-916e-4769-891a-e1add0b0a5a6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6ad312-3ea6-41c4-afd1-01db15cd3273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Volume volume-54a10d82-916e-4769-891a-e1add0b0a5a6 (54a10d82-916e-4769-891a-e1add0b0a5a6): created successfully Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6ad312-3ea6-41c4-afd1-01db15cd3273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Flow 'volume_create_manager' (1fce7c9d-b092-4c22-944f-4dd48ba5198a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-109bc57a-5bfd-4f26-830c-f064a41f2fb3 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created volume successfully. Nov 03 12:25:29 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 Nov 03 12:25:29 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38" returned: 0 in 0.416s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 Nov 03 12:25:30 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-54a10d82-916e-4769-891a-e1add0b0a5a6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc 1073741824" returned: 0 in 0.544s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-54a10d82-916e-4769-891a-e1add0b0a5a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-54a10d82-916e-4769-891a-e1add0b0a5a6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:30 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:30 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-54a10d82-916e-4769-891a-e1add0b0a5a6" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0750b79e-71b0-41bf-813d-16264d0d3db1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8" returned: 0 in 0.390s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 Nov 03 12:25:30 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8 Nov 03 12:25:30 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.288s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485764571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7125dc913a0945398ee617e5dd46b5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:26Z,use_quota=True,user_id='dfb46a8b7cf64cdcb6010063ca1334e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Creating volume c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ef9f5-335d-43e0-aaf6-3a3ca33a4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:30 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 1073741824 Nov 03 12:25:30 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecc09cc-d47f-4075-8a0a-6e1e6d1dbd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Volume volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc (4ccf15a5-9206-4b41-931d-38d7f233ccfc): created successfully Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecc09cc-d47f-4075-8a0a-6e1e6d1dbd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Flow 'volume_create_manager' (6744056b-3192-4bd1-921f-f5bb4df7e114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ecf41d33-8236-420b-9b9d-554fe9c2fd44 tempest-VolumeDependencyTests-641625530 None] Created volume successfully. Nov 03 12:25:30 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38.f08d5fa1-84f0-4afc-b1d5-5043924a69e8" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6" returned: 0 in 0.423s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-f08d5fa1-84f0-4afc-b1d5-5043924a69e8" released by "_delete_snapshot" :: held 1.597s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" released by "delete_snapshot" :: held 1.626s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:30 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6 Nov 03 12:25:30 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Created reservations ['8cfbbb08-c6f1-48d0-8902-ed642abb819b', '884e73f5-0131-41de-b58a-9da0afeaa2e0', '9ab4f0a3-20b6-49be-b4dd-8731e7f11694', 'cf8eb288-57aa-4b62-98e2-0589a87fcc60'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Delete snapshot completed successfully. Nov 03 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c075c491-42d3-4489-a2da-e9db2d4368f4 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-f08d5fa1-84f0-4afc-b1d5-5043924a69e8-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:31 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-54a10d82-916e-4769-891a-e1add0b0a5a6" returned: 0 in 0.301s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-54a10d82-916e-4769-891a-e1add0b0a5a6" released by "delete_volume" :: held 0.778s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:31 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 1073741824" returned: 0 in 0.554s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['f2e367d5-6ba6-4b4a-bc15-a09540303f25', 'ef58a34d-f5b8-4247-92a1-e8c4183c2dcb', 'f1d111c5-41b8-4478-9405-28fcf52efcfa', 'b74baa5e-cb42-48c2-a9ed-800cf84301c5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 Nov 03 12:25:31 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:31 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-958659bb-704d-469b-b968-35f9390a8b38-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "cinder-958659bb-704d-469b-b968-35f9390a8b38-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-c7bab708-d35c-4192-bc08-3e0a63ac002c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-c7bab708-d35c-4192-bc08-3e0a63ac002c-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:31 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.213s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a39579-eaaa-43ae-9447-14fc4afb5a50]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Creating offline snapshot 4a1815c6-535b-4815-8065-211e82409160 of volume 4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cb239a-d03a-4cf9-8495-635af7368abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc6186c-d2af-4093-af7a-e77cf2611353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:31 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72837bf-1f4d-428e-9389-2d07ff24c72b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-c7bab708-d35c-4192-bc08-3e0a63ac002c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.376s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Volume volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 (c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488): created successfully Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc6186c-d2af-4093-af7a-e77cf2611353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Flow 'volume_create_manager' (0c5d7438-b22d-4e3d-823e-0c0415f40fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:31 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 Nov 03 12:25:31 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-c7bab708-d35c-4192-bc08-3e0a63ac002c" acquired by "delete_volume" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-33eadac7-7dff-4c68-8ef2-801073b4fd73 tempest-ProjectReaderTests-1959844795 None] Created volume successfully. Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d105a99-bda2-4843-b2ad-91aa4b6f6903 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-54a10d82-916e-4769-891a-e1add0b0a5a6-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a95224f-31a3-42c8-99f3-e73f71b8e321]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:31 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:31 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c Nov 03 12:25:31 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:31 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38" returned: 0 in 0.420s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:31 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38 Nov 03 12:25:31 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.443s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 1G Nov 03 12:25:32 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c" returned: 0 in 0.420s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c Nov 03 12:25:32 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-958659bb-704d-469b-b968-35f9390a8b38" returned: 0 in 0.285s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-958659bb-704d-469b-b968-35f9390a8b38" released by "delete_volume" :: held 0.816s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Created reservations ['bd9310ec-e3cc-4115-8db2-eba0cad2f868', '9d56f5bf-48f7-4128-a39e-e6b30ad576e1', '73aa1a40-904b-4401-bc25-99e6f8fa8edc', 'b15d92a4-eb9d-4837-be75-dc47dd9c9a09'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:32 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c7bab708-d35c-4192-bc08-3e0a63ac002c" returned: 0 in 0.304s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-c7bab708-d35c-4192-bc08-3e0a63ac002c" released by "delete_volume" :: held 0.791s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-ad28289b-767c-499d-abd9-04bf62ab5b73-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:32 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 1G" returned: 0 in 0.518s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-ad28289b-767c-499d-abd9-04bf62ab5b73-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['06f8980e-d28d-4a8b-af2e-0f4b88e02bf6', '76d9082e-6fee-4c63-aebc-4342f1b43bc4', '753182ff-3219-4b18-94dd-d64cdacbdee5', '38a4296b-b6df-40da-a628-52f7202abfab'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:32 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:32 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "cinder-quobyte-ad28289b-767c-499d-abd9-04bf62ab5b73" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-ad28289b-767c-499d-abd9-04bf62ab5b73" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d9d1d-2895-48d2-a96d-001e364297b3]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:32 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Deleted volume successfully. Nov 03 12:25:32 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:32 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-da823dea-b78e-4d45-ad2b-f6a4b4eed43c tempest-CinderUnicodeTest-883409122 None] Lock "cinder-958659bb-704d-469b-b968-35f9390a8b38-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:32 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 Nov 03 12:25:32 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Acquiring lock "cinder-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "cinder-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Acquiring lock "cinder-quobyte-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:32 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.438s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:32 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 is being set with open permissions: ugo+rw Nov 03 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "cinder-quobyte-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:33 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:33 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7363ff4-d9a4-412b-a63c-6842a96276d7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-46a96d65-bb4c-48a7-aa5d-276dab5d935a tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-c7bab708-d35c-4192-bc08-3e0a63ac002c-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:33 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73" returned: 0 in 0.478s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 Nov 03 12:25:33 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73 Nov 03 12:25:33 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info Nov 03 12:25:33 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-ad28289b-767c-499d-abd9-04bf62ab5b73" returned: 0 in 0.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-quobyte-ad28289b-767c-499d-abd9-04bf62ab5b73" released by "delete_volume" :: held 0.812s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" returned: 0 in 0.418s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488 Nov 03 12:25:33 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Created reservations ['d1360bd2-fee4-40df-8c4e-01ef0c6d47c9', 'd639212f-b243-456f-8d2e-081badb30efe', '5eb67a7c-6b26-4b8b-acc8-24f77014333c', '082ff8c8-785a-44d0-9a79-106b5bf0b05c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info" returned: 0 in 0.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info is being set with open permissions: ugo+rw Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:33 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info Nov 03 12:25:33 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:33 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-facccedb-370b-4b65-94b0-22b321eda84f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" returned: 0 in 0.295s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-facccedb-370b-4b65-94b0-22b321eda84f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "cinder-quobyte-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488" released by "delete_volume" :: held 0.797s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-facccedb-370b-4b65-94b0-22b321eda84f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-facccedb-370b-4b65-94b0-22b321eda84f" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ad208-22b0-4c8f-aa6b-fece80830498]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:33 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Created reservations ['d66e72a3-7051-4be1-9d58-f584acdcea56', '2913554e-1efd-44eb-8828-0ff330399174', 'a264c37e-04e8-4149-afeb-2f612537f497', 'a83d6463-5055-4526-9381-59882eb882b5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.info" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:34 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.464s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:34 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f Nov 03 12:25:34 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6a77d9d7-41ce-44d5-88e2-d7d21c6e30a8 tempest-VolumeDependencyTests-641625530 None] Create snapshot completed successfully Nov 03 12:25:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Deleted volume successfully. Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b2f03b57-a099-4ec2-bc0e-dc3127858440 tempest-CinderUnicodeTest-883409122 None] Lock "cinder-ad28289b-767c-499d-abd9-04bf62ab5b73-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:34 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:34 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:34 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f" returned: 0 in 0.444s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:34 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f Nov 03 12:25:34 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:34 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Deleted volume successfully. Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-891418cb-67c7-4bf6-875d-59cfaab94b89 tempest-ProjectReaderTests-1959844795 None] Lock "cinder-c4e9d2de-cbd3-4b3d-bc8b-2bf7de063488-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:34 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-facccedb-370b-4b65-94b0-22b321eda84f" returned: 0 in 0.341s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-facccedb-370b-4b65-94b0-22b321eda84f" released by "delete_volume" :: held 0.847s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['166a2b27-c084-48a3-b360-75dc1a84e49f', 'f6607fdc-6340-4b70-9b01-9cf82d87dd9f', '5201f786-9a0f-4284-9d4c-d56abfceb434', 'b2aed54b-0df1-464d-97cf-fe34c6bbdcd1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:35 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:35 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Flow 'volume_create_manager' (28d4916a-5487-416e-835e-3b1de9324a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51274658-8a68-4ea4-ac82-f7776207186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51274658-8a68-4ea4-ac82-f7776207186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-65188073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c06229-40da-48b1-9050-79319d4aa074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2837e14f14a44856ba0f050741571837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a1815c6-535b-4815-8065-211e82409160,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:35Z,use_quota=True,user_id='959a684bd25f4c27a893ad55cb7948fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cc6aed-2903-4fb9-b0e2-6a28481dcad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cc6aed-2903-4fb9-b0e2-6a28481dcad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca86604-0c4e-45f0-bbb8-f8dda37ae349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca86604-0c4e-45f0-bbb8-f8dda37ae349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1c06229-40da-48b1-9050-79319d4aa074', 'volume_name': 'volume-a1c06229-40da-48b1-9050-79319d4aa074', 'volume_size': 1, 'snapshot_id': '4a1815c6-535b-4815-8065-211e82409160'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f05a529-e9fd-4b23-ae91-5d1d1444d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f05a529-e9fd-4b23-ae91-5d1d1444d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7cc621-eb61-49c3-9e12-545ffa1b1492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Volume a1c06229-40da-48b1-9050-79319d4aa074: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1c06229-40da-48b1-9050-79319d4aa074', 'volume_size': 1, 'snapshot_id': '4a1815c6-535b-4815-8065-211e82409160'} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160-a1c06229-40da-48b1-9050-79319d4aa074" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160-a1c06229-40da-48b1-9050-79319d4aa074" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Creating volume a1c06229-40da-48b1-9050-79319d4aa074 from snapshot 4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] snapshot: 4a1815c6-535b-4815-8065-211e82409160, volume: a1c06229-40da-48b1-9050-79319d4aa074, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:25:35 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.353s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc861203-1506-4182-b262-008a439a4ccb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4f5ffead-52b6-4388-8972-eda298e7dd79 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-facccedb-370b-4b65-94b0-22b321eda84f-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:35 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:35 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:35 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec7e574-9ceb-47b5-ac07-23ddc47f7d25]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:35 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:35 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-a1cde1f2-5b61-4153-969b-56753b2e5a69-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-a1cde1f2-5b61-4153-969b-56753b2e5a69-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-a1cde1f2-5b61-4153-969b-56753b2e5a69" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-a1cde1f2-5b61-4153-969b-56753b2e5a69" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea5dde4-1f07-41f2-890f-e7d7133c981c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:36 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 Nov 03 12:25:36 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:36 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.574s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:36 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 Nov 03 12:25:36 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:36 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69" returned: 0 in 0.492s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:36 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69 Nov 03 12:25:36 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:37 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1cde1f2-5b61-4153-969b-56753b2e5a69" returned: 0 in 0.310s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-a1cde1f2-5b61-4153-969b-56753b2e5a69" released by "delete_volume" :: held 0.861s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['866fb3fb-79e0-4980-9a17-56181aca8df7', 'aacbaac4-836f-4e1d-96e2-57f77b31e4ef', '346f8686-9337-42e8-8562-420c4227b021', '014a90e8-d7ad-4197-8b8b-67e7e020f38a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:37 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:37 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:38 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.608s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b292e6d9-e337-4a0e-9547-46cae49ff383 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-a1cde1f2-5b61-4153-969b-56753b2e5a69-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-395247d9-f9c3-477a-8bb6-de3939382360-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-395247d9-f9c3-477a-8bb6-de3939382360-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-395247d9-f9c3-477a-8bb6-de3939382360" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-395247d9-f9c3-477a-8bb6-de3939382360" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eddd6c3-e432-49a5-9741-278d0432e3c5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:38 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 Nov 03 12:25:38 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:39 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:39 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360 Nov 03 12:25:39 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:40 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-395247d9-f9c3-477a-8bb6-de3939382360" returned: 0 in 0.770s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-395247d9-f9c3-477a-8bb6-de3939382360" released by "delete_volume" :: held 1.818s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['a57b0609-2417-46d2-8b6a-b1abf9ef989c', 'e29bb3d2-cd53-404d-890d-8421aea41c16', 'b1172f76-8a5d-4eea-b88c-100bcb3e4de6', '7d3f0b56-c0bb-4216-9825-17da8011bbdc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:40 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:40 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleting offline snapshot a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a of volume 3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:25:41 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] snapshot_file for this snap is: volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.525s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[619dbc20-29b1-4e84-b4a7-ac490df1933c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-098e763b-b22d-4a15-ac45-44f8ed62ad53 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-395247d9-f9c3-477a-8bb6-de3939382360-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:41 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a Nov 03 12:25:41 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:42 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" returned: 0 in 0.764s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044ef87-1558-4210-8df5-a36a4d14e25d]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:42 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 Nov 03 12:25:42 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:42 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" returned: 0 in 0.671s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:42 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a Nov 03 12:25:42 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:43 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" returned: 0 in 0.786s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:43 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a Nov 03 12:25:43 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:44 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6.a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" returned: 0 in 0.557s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a" released by "_delete_snapshot" :: held 3.064s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" released by "delete_snapshot" :: held 3.140s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:44 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['f37a382c-9f9c-4898-9bba-7497da134d6e', '8ac19577-587c-4efa-bb7a-308032c71b54', '7c29327f-7cb2-4e02-9e86-a283fc69b7b1', 'f8bd76a2-e41c-4d4f-8e19-20bea2485ef7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Delete snapshot completed successfully. Nov 03 12:25:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-64511ab9-964e-40c8-817b-6202610741d1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-a1d1f3ab-aee2-4e53-8086-a7136c0d8c3a-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" acquired by "delete_volume" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f06ce-c571-46cd-8496-537c93bdc4ec]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:46 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074" returned: 0 in 9.616s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:25:46 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Converted 1024.00 MB image at 106.46 MB/s Nov 03 12:25:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 is being set with open permissions: ugo+rw Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:46 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 Nov 03 12:25:46 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:46 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 Nov 03 12:25:46 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:46 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" returned: 0 in 0.451s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:46 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074" returned: 0 in 0.330s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:46 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6 Nov 03 12:25:46 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" released by "_copy_volume_from_snapshot" :: held 11.037s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160-a1c06229-40da-48b1-9050-79319d4aa074" released by "_create_volume_from_snapshot" :: held 11.113s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.134s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7cc621-eb61-49c3-9e12-545ffa1b1492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c06229-40da-48b1-9050-79319d4aa074', 'volume_size': 1, 'snapshot_id': '4a1815c6-535b-4815-8065-211e82409160'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c17baf9-b251-45f2-a3ee-11e6db7e2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Volume volume-a1c06229-40da-48b1-9050-79319d4aa074 (a1c06229-40da-48b1-9050-79319d4aa074): created successfully Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c17baf9-b251-45f2-a3ee-11e6db7e2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Flow 'volume_create_manager' (28d4916a-5487-416e-835e-3b1de9324a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-28c6538c-0210-4f2e-a41d-15341b1e7889 tempest-VolumeDependencyTests-641625530 None] Created volume successfully. Nov 03 12:25:46 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" returned: 0 in 0.317s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-quobyte-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6" released by "delete_volume" :: held 0.940s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Created reservations ['3c753029-c638-4c87-9652-0ad51d56774f', '47f2b0a1-a664-403b-824c-7ef3b12b08cf', 'a203e426-0f30-4f96-9783-4d55b37c58cb', '8daefdde-99a2-41a7-b94d-7fd715473a72'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:46 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:46 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:47 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.319s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Deleted volume successfully. Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5fa97b13-7bd6-4898-baae-11af82681cc1 tempest-CreateVolumesFromSnapshotTest-1483635089 None] Lock "cinder-3e8b2c2e-2da0-4c47-94fc-c8e62cbde5d6-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-4a1815c6-535b-4815-8065-211e82409160-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-4a1815c6-535b-4815-8065-211e82409160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Deleting offline snapshot 4a1815c6-535b-4815-8065-211e82409160 of volume 4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] snapshot_file for this snap is: volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b68e57-ac3c-4b9e-ade5-9e68a84fa191]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:47 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:47 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:48 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:25:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db92e8f-161b-4106-b68c-373aae801eaf]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:48 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:48 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:48 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.851s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:49 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:49 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:49 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.491s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:49 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160 Nov 03 12:25:49 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:49 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc.4a1815c6-535b-4815-8065-211e82409160" returned: 0 in 0.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4a1815c6-535b-4815-8065-211e82409160" released by "_delete_snapshot" :: held 2.522s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" released by "delete_snapshot" :: held 2.552s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Created reservations ['2383ef3d-c117-4521-8644-a8efa2277139', 'd5675cb2-4600-465d-a310-f36b608cd64a', 'c2cff732-e7c3-42a3-9c9d-abf2d790489f', 'f8e5e025-fbce-4c38-8800-f8b7a2771f9d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Delete snapshot completed successfully. Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1875e69-30e7-4313-b699-aa3f02ee227d tempest-VolumeDependencyTests-641625530 None] Lock "cinder-4a1815c6-535b-4815-8065-211e82409160-delete_snapshot" released by "delete_snapshot" :: held 2.728s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-4ccf15a5-9206-4b41-931d-38d7f233ccfc-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-4ccf15a5-9206-4b41-931d-38d7f233ccfc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01a4c9-ebd2-43da-bdbd-e93d8e3093fb]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:51 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:51 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:51 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.531s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:51 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc Nov 03 12:25:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:51 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-4ccf15a5-9206-4b41-931d-38d7f233ccfc" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-4ccf15a5-9206-4b41-931d-38d7f233ccfc" released by "delete_volume" :: held 0.962s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Created reservations ['fd056e52-89ad-43f0-8e52-3cb0ce9cf9e9', '9424a145-c948-422b-bc91-bc4c4b7cc2ec', 'dc13953b-69a3-4937-829b-c479110ea6c2', 'c74463ff-bc17-48c9-b00f-c6bb61f756ff'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:52 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:52 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:52 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Deleted volume successfully. Nov 03 12:25:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-71dd6eec-fd70-4edb-9872-2bbad19af474 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-4ccf15a5-9206-4b41-931d-38d7f233ccfc-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-a1c06229-40da-48b1-9050-79319d4aa074-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-a1c06229-40da-48b1-9050-79319d4aa074-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02c8536-4cd3-4ef3-a706-43cc37b99038]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:53 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 Nov 03 12:25:53 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:53 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074" returned: 0 in 0.597s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:53 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074 Nov 03 12:25:53 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:54 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a1c06229-40da-48b1-9050-79319d4aa074" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-quobyte-a1c06229-40da-48b1-9050-79319d4aa074" released by "delete_volume" :: held 0.933s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Created reservations ['7114986b-bd2b-4f1b-af95-06441e61a960', '98fea0d9-62bd-45e6-8a31-698a6191a5ff', '17aadc19-d3c5-425d-ba44-94da4586986a', 'f07107f1-2a05-47cf-a0e4-ce9d4ac6de36'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:54 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:25:54 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:54 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.309s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:25:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Deleted volume successfully. Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1902a64-8393-4ef8-838f-ca88495502d7 tempest-VolumeDependencyTests-641625530 None] Lock "cinder-a1c06229-40da-48b1-9050-79319d4aa074-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (5c214723-68ab-4ffb-8723-c885e98ea534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee62600-0270-420f-ab9f-bb0dd023cd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee62600-0270-420f-ab9f-bb0dd023cd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66496409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b28b24-fd71-41d5-8f54-90b8ae805b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:55Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d933e0-1898-4caf-8088-77844e40d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d933e0-1898-4caf-8088-77844e40d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66147f9a-f444-45f4-98dd-e3e027302d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66147f9a-f444-45f4-98dd-e3e027302d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b28b24-fd71-41d5-8f54-90b8ae805b0a', 'volume_name': 'volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b1c3f9-2ec8-4479-be52-b74795c40b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b1c3f9-2ec8-4479-be52-b74795c40b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c8f150-2057-4bd3-a561-f24e2df9a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Volume f2b28b24-fd71-41d5-8f54-90b8ae805b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a', 'volume_size': 1} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66496409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b28b24-fd71-41d5-8f54-90b8ae805b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:25:55Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Creating volume f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:25:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:55 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a 1073741824 Nov 03 12:25:55 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:55 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a 1073741824" returned: 0 in 0.625s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=226,cinder:UPDATE=316,cinder:INSERT=75,cinder:DELETE=25 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=285,cinder:SELECT=208,cinder:DELETE=28,cinder:INSERT=84 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:55 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a Nov 03 12:25:55 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:56 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" returned: 0 in 0.434s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c8f150-2057-4bd3-a561-f24e2df9a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42667104-df46-4ba4-80ab-3c297936424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:25:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Volume volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a (f2b28b24-fd71-41d5-8f54-90b8ae805b0a): created successfully Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42667104-df46-4ba4-80ab-3c297936424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:25:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (5c214723-68ab-4ffb-8723-c885e98ea534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:25:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2c299f03-a448-49a8-97a2-8865cda80447 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot 96f52ff7-8b1b-44ec-afcb-bf5c800d0975 of volume f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0d7f8-b943-48cc-8806-29f6b7c1f37e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:57 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a Nov 03 12:25:57 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:57 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:57 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 1G Nov 03 12:25:57 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:58 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 1G" returned: 0 in 0.513s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:58 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 Nov 03 12:25:58 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:58 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975" returned: 0 in 0.447s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:58 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 is being set with open permissions: ugo+rw Nov 03 12:25:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:58 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 Nov 03 12:25:58 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:59 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975" returned: 0 in 0.327s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ed6b6d5e-e48c-4ef6-9d6c-7dbb5849c342 tempest-ProjectAdminTests-1204517217 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.73637008667, 'free_capacity_gb': 1773.73637008667, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:59 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info Nov 03 12:25:59 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:59 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info" returned: 0 in 0.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:59 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info is being set with open permissions: ugo+rw Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:25:59 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info Nov 03 12:25:59 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:25:59 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.info" returned: 0 in 0.312s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9aa35dff-473f-4ce0-9eeb-e5f5d7eb4a4e tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-96f52ff7-8b1b-44ec-afcb-bf5c800d0975-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-96f52ff7-8b1b-44ec-afcb-bf5c800d0975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-96f52ff7-8b1b-44ec-afcb-bf5c800d0975" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-96f52ff7-8b1b-44ec-afcb-bf5c800d0975" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot 96f52ff7-8b1b-44ec-afcb-bf5c800d0975 of volume f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c36b25-5730-493a-9611-22503fa80f70]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:00 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 Nov 03 12:26:00 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:01 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975" returned: 0 in 0.500s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0d834-dc4e-45a2-93c6-fb80ae5561bd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:01 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a Nov 03 12:26:01 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:01 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" returned: 0 in 0.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:01 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 Nov 03 12:26:01 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:02 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975" returned: 0 in 0.506s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:02 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975 Nov 03 12:26:02 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:02 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a.96f52ff7-8b1b-44ec-afcb-bf5c800d0975" returned: 0 in 0.311s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-96f52ff7-8b1b-44ec-afcb-bf5c800d0975" released by "_delete_snapshot" :: held 1.963s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" released by "delete_snapshot" :: held 1.994s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Created reservations ['94741269-e571-4d22-acb2-df56a193fe30', '08ff8337-2c7f-4676-8278-711415e3468e', '791e0fd9-8c79-42f5-8920-cb15390f968e', '034c178a-c199-4812-b665-d8f26e44e13e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-528529b3-cff5-47bf-8b47-ffcdce425fc0 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-96f52ff7-8b1b-44ec-afcb-bf5c800d0975-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-f2b28b24-fd71-41d5-8f54-90b8ae805b0a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f2b28b24-fd71-41d5-8f54-90b8ae805b0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb1a01-7103-4d51-8ed5-0886a1aea9a9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:04 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a Nov 03 12:26:04 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:04 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" returned: 0 in 0.507s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:04 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a Nov 03 12:26:04 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:05 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" returned: 0 in 0.371s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f2b28b24-fd71-41d5-8f54-90b8ae805b0a" released by "delete_volume" :: held 1.018s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Created reservations ['fd504192-573e-497f-9797-340a55c6f4d7', 'ad46bdc2-4a2c-46a9-89d4-531f4802f41d', '9ef3cb44-0745-43cc-a8a2-f4cc15d5bfec', '66a160b0-e62b-4d5f-a617-ddf58acbfbff'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:05 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:05 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:05 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bce9b892-ad87-4b8f-92c4-312c8822238b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f2b28b24-fd71-41d5-8f54-90b8ae805b0a-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7e2f7c34-7ecc-4465-841d-2a6b651a6fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772aaa49-295e-448c-8593-c72d0dc6ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772aaa49-295e-448c-8593-c72d0dc6ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139000600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd813b0-d31d-4dca-a350-725abd726f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:07Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9d72dd-926a-4192-958b-890d123eaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9d72dd-926a-4192-958b-890d123eaf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531676f6-6e9a-4151-802b-d464771562a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531676f6-6e9a-4151-802b-d464771562a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd813b0-d31d-4dca-a350-725abd726f63', 'volume_name': 'volume-2cd813b0-d31d-4dca-a350-725abd726f63', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81c0a93-a303-493f-9cc1-cc338f1708f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81c0a93-a303-493f-9cc1-cc338f1708f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a3594f-81ad-467d-9931-8589b0ece6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Volume 2cd813b0-d31d-4dca-a350-725abd726f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd813b0-d31d-4dca-a350-725abd726f63', 'volume_size': 1} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139000600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd813b0-d31d-4dca-a350-725abd726f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:07Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Creating volume 2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:07 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 1073741824 Nov 03 12:26:07 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:07 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 1073741824" returned: 0 in 0.640s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:08 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 Nov 03 12:26:08 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:08 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a3594f-81ad-467d-9931-8589b0ece6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd813b0-d31d-4dca-a350-725abd726f63', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0c6aa8-e94d-4e53-8028-c93ff22bad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Volume volume-2cd813b0-d31d-4dca-a350-725abd726f63 (2cd813b0-d31d-4dca-a350-725abd726f63): created successfully Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0c6aa8-e94d-4e53-8028-c93ff22bad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7e2f7c34-7ecc-4465-841d-2a6b651a6fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d1258120-c817-4c50-bd2c-6df9cedfced4 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot 090664f9-f885-4e81-b00d-0b6115b6757e of volume 2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0d5363-0cd3-4a01-a51e-89925567933a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:09 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 Nov 03 12:26:09 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:10 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63" returned: 0 in 0.562s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:10 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e 1G Nov 03 12:26:10 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Flow 'volume_create_manager' (33d1f76b-84eb-443d-92b6-e7cce213dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b99c55-86ce-4020-9d5e-86a1ac190791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b99c55-86ce-4020-9d5e-86a1ac190791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-974858175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc59e6-4389-4668-9ceb-f32845ec6444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8aaa62415444067a613a014f1e7e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:10Z,use_quota=True,user_id='ab9a31948dde4b2b9f9fa88211292732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4249478-4b40-4df5-9a75-510fe0e605b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4249478-4b40-4df5-9a75-510fe0e605b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6f8080-69f8-4e2b-ab47-727f1e4c7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6f8080-69f8-4e2b-ab47-727f1e4c7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bc59e6-4389-4668-9ceb-f32845ec6444', 'volume_name': 'volume-b0bc59e6-4389-4668-9ceb-f32845ec6444', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57fb022-1772-47c8-b3fa-b32f3802f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57fb022-1772-47c8-b3fa-b32f3802f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a89e51f-7979-4bd1-a1c3-278e179b229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Volume b0bc59e6-4389-4668-9ceb-f32845ec6444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bc59e6-4389-4668-9ceb-f32845ec6444', 'volume_size': 1} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:10 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e 1G" returned: 0 in 0.667s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd813b0-d31d-4dca-a350-725abd726f63 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:10 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd813b0-d31d-4dca-a350-725abd726f63 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e Nov 03 12:26:10 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:11 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd813b0-d31d-4dca-a350-725abd726f63 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e" returned: 0 in 0.334s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e is being set with open permissions: ugo+rw Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:11 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e Nov 03 12:26:11 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:11 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e" returned: 0 in 0.274s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:11 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info Nov 03 12:26:11 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:11 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info" returned: 0 in 0.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info is being set with open permissions: ugo+rw Nov 03 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:11 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info Nov 03 12:26:11 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:12 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.info" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-974858175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc59e6-4389-4668-9ceb-f32845ec6444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8aaa62415444067a613a014f1e7e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:10Z,use_quota=True,user_id='ab9a31948dde4b2b9f9fa88211292732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Creating volume b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:12 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 1073741824 Nov 03 12:26:12 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-83ed44d5-d983-4214-acbd-ffdd332a1451 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:12 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 1073741824" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-090664f9-f885-4e81-b00d-0b6115b6757e-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:12 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:12 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-090664f9-f885-4e81-b00d-0b6115b6757e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-090664f9-f885-4e81-b00d-0b6115b6757e" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-090664f9-f885-4e81-b00d-0b6115b6757e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot 090664f9-f885-4e81-b00d-0b6115b6757e of volume 2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265e9b4-fd73-462f-b02e-8b337defca77]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:12 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.303s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:12 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e Nov 03 12:26:12 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a89e51f-7979-4bd1-a1c3-278e179b229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bc59e6-4389-4668-9ceb-f32845ec6444', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9c6e1-2397-45aa-8263-2d947de87520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Volume volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 (b0bc59e6-4389-4668-9ceb-f32845ec6444): created successfully Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9c6e1-2397-45aa-8263-2d947de87520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Flow 'volume_create_manager' (33d1f76b-84eb-443d-92b6-e7cce213dd67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b612f815-483c-4e9d-b071-ccf21087c108 tempest-SnapshotDependencyTests-883570388 None] Created volume successfully. Nov 03 12:26:13 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e" returned: 0 in 0.494s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd813b0-d31d-4dca-a350-725abd726f63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (7d297eb4-0fea-4904-bdd6-4d3e22dd6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30a5429-46a6-4b93-a24a-d97dac498fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8982a-a5bf-43e8-b9b2-b924a22b7a3e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30a5429-46a6-4b93-a24a-d97dac498fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717776487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942ba581-6963-4663-bd32-4ea2596b6bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:13Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b00565-e4c0-4c0f-87a4-30dba5014340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b00565-e4c0-4c0f-87a4-30dba5014340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3938d95-28a0-4b34-a9a6-e5e492060ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3938d95-28a0-4b34-a9a6-e5e492060ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942ba581-6963-4663-bd32-4ea2596b6bab', 'volume_name': 'volume-942ba581-6963-4663-bd32-4ea2596b6bab', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19dce519-1f12-43c0-8359-d8f962af5385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19dce519-1f12-43c0-8359-d8f962af5385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f17c50-cdfa-45b2-8e8a-29a0950e8982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Volume 942ba581-6963-4663-bd32-4ea2596b6bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942ba581-6963-4663-bd32-4ea2596b6bab', 'volume_size': 1} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717776487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942ba581-6963-4663-bd32-4ea2596b6bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:13Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Creating volume 942ba581-6963-4663-bd32-4ea2596b6bab {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:13 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:13 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 Nov 03 12:26:13 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:13 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab 1073741824 Nov 03 12:26:13 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:13 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63" returned: 0 in 0.432s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:13 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e Nov 03 12:26:13 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:14 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab 1073741824" returned: 0 in 0.557s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:14 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab Nov 03 12:26:14 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:14 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e" returned: 0 in 0.482s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:14 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e Nov 03 12:26:14 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:14 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab" returned: 0 in 0.287s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Creating offline snapshot 5c3f6877-ae54-4329-aae9-a66f857aea3a of volume b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f17c50-cdfa-45b2-8e8a-29a0950e8982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942ba581-6963-4663-bd32-4ea2596b6bab', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0263932d-ef61-47d0-aa4c-bdd5bf110117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5270a2b-b091-4d79-a53f-c5705beb0fa9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Volume volume-942ba581-6963-4663-bd32-4ea2596b6bab (942ba581-6963-4663-bd32-4ea2596b6bab): created successfully Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0263932d-ef61-47d0-aa4c-bdd5bf110117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (7d297eb4-0fea-4904-bdd6-4d3e22dd6884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0d0151d2-c893-4cb4-bcba-c2d5a7d73e9f tempest-ProjectReaderTests-382859683 None] Created volume successfully. Nov 03 12:26:14 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:14 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:14 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63.090664f9-f885-4e81-b00d-0b6115b6757e" returned: 0 in 0.288s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-090664f9-f885-4e81-b00d-0b6115b6757e" released by "_delete_snapshot" :: held 1.848s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" released by "delete_snapshot" :: held 1.887s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Created reservations ['e34fbd1f-5ef5-4014-9280-f825296234ee', '136f49a8-8a4f-469d-b467-7a869cb6ba36', '2163fca1-d82d-4bc3-8991-f654ef4e2b0c', '2afed41e-a58e-40be-ab22-6dee4ec09b7e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a7d87dd9-0abe-4a09-974c-f13f7eff0404 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-090664f9-f885-4e81-b00d-0b6115b6757e-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:14 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.429s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:14 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a 1G Nov 03 12:26:14 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-2cd813b0-d31d-4dca-a350-725abd726f63-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-2cd813b0-d31d-4dca-a350-725abd726f63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae7934-7d8f-485f-b89a-53a2fcaab952]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:15 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a 1G" returned: 0 in 0.498s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:15 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 Nov 03 12:26:15 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:15 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:15 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-942ba581-6963-4663-bd32-4ea2596b6bab-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "cinder-942ba581-6963-4663-bd32-4ea2596b6bab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:15 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-quobyte-942ba581-6963-4663-bd32-4ea2596b6bab" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63" returned: 0 in 0.484s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-942ba581-6963-4663-bd32-4ea2596b6bab" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:15 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63 Nov 03 12:26:15 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:15 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.407s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a is being set with open permissions: ugo+rw Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff631acc-5e00-41d4-b0c1-ca63cf539e14]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:15 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:15 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:15 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab Nov 03 12:26:15 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:16 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2cd813b0-d31d-4dca-a350-725abd726f63" returned: 0 in 0.378s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2cd813b0-d31d-4dca-a350-725abd726f63" released by "delete_volume" :: held 0.928s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:16 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info Nov 03 12:26:16 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Created reservations ['923e6cea-dc7c-4e2f-8ac1-a4682b7cdda1', '4db79130-1756-4af4-ac43-6e186e338b88', 'a9b0831d-7623-49b8-bbf5-2ccb0bbb7ba3', 'c5f8df69-7811-45f2-a5b8-383e2cca9c1b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:16 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab" returned: 0 in 0.550s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:16 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:16 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:16 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab Nov 03 12:26:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:16 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info" returned: 0 in 0.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info is being set with open permissions: ugo+rw Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:16 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info Nov 03 12:26:16 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:16 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-775c73f0-f91a-4eb4-993f-e3c85b5d952e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-2cd813b0-d31d-4dca-a350-725abd726f63-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:16 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-942ba581-6963-4663-bd32-4ea2596b6bab" returned: 0 in 0.330s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-942ba581-6963-4663-bd32-4ea2596b6bab" released by "delete_volume" :: held 0.945s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Created reservations ['9d2801f1-2271-4fb2-b4d0-e47c74ecd96a', 'b2213297-4628-4db9-8417-e7274799e9de', 'd5995121-46bd-4e18-bdb7-edd51a03e43a', '6bcae0bc-ebf5-4bcc-8522-04b4df61d4a5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:16 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.info" returned: 0 in 0.303s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-85db7e31-e842-40d7-8133-69e98133c7f8 tempest-SnapshotDependencyTests-883570388 None] Create snapshot completed successfully Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:16 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:16 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:17 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Deleted volume successfully. Nov 03 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1bde23c6-5f69-430d-b5da-f6bc2964077a tempest-ProjectReaderTests-382859683 None] Lock "cinder-942ba581-6963-4663-bd32-4ea2596b6bab-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (73097e1a-a002-48be-8148-7d7f08b73e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf6e370-3d4d-4dda-be3e-accce4a8152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf6e370-3d4d-4dda-be3e-accce4a8152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597267940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb64c5f-4fd8-4858-ace5-b292e323fb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:18Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00421329-498b-4956-97a8-f2d2cf2c3ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00421329-498b-4956-97a8-f2d2cf2c3ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d741a0a-b144-407e-ac35-17362f069c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d741a0a-b144-407e-ac35-17362f069c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb64c5f-4fd8-4858-ace5-b292e323fb6f', 'volume_name': 'volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0be71e-5b7a-42ff-9cde-ab73bacefdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0be71e-5b7a-42ff-9cde-ab73bacefdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d121978-fc26-4fe7-a0ec-9ea4888fb6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Volume 8cb64c5f-4fd8-4858-ace5-b292e323fb6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f', 'volume_size': 1} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597267940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb64c5f-4fd8-4858-ace5-b292e323fb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:18Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Creating volume 8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:18 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Flow 'volume_create_manager' (baa00853-814b-42e5-ba44-3737058a4a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:18 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f 1073741824 Nov 03 12:26:18 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a3960-44b5-4a13-b77c-d40e848d6eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a3960-44b5-4a13-b77c-d40e848d6eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8aaa62415444067a613a014f1e7e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c3f6877-ae54-4329-aae9-a66f857aea3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:18Z,use_quota=True,user_id='ab9a31948dde4b2b9f9fa88211292732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572933b-def9-4927-9f40-d4ec2552283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572933b-def9-4927-9f40-d4ec2552283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2ffea-05ca-46a7-ab94-0707167f72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2ffea-05ca-46a7-ab94-0707167f72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491', 'volume_name': 'volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491', 'volume_size': 1, 'snapshot_id': '5c3f6877-ae54-4329-aae9-a66f857aea3a'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fbb7d-fa51-4854-9e9c-bc11afdb1ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fbb7d-fa51-4854-9e9c-bc11afdb1ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4595707-3c94-41fa-aa1b-67351fbfc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Volume bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491', 'volume_size': 1, 'snapshot_id': '5c3f6877-ae54-4329-aae9-a66f857aea3a'} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (ba4e2072-4d96-412b-99cb-ff0171af217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e70af5b-7771-442b-90be-824af7fd1304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e70af5b-7771-442b-90be-824af7fd1304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398159116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d8da9e-37d7-4ebb-9eec-5137880ee485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:18Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902438d9-718a-42ed-b566-d97be698238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902438d9-718a-42ed-b566-d97be698238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fda7eb3-fe0d-4e2e-88a7-802e11adbbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fda7eb3-fe0d-4e2e-88a7-802e11adbbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d8da9e-37d7-4ebb-9eec-5137880ee485', 'volume_name': 'volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f80efa-5af2-4188-af61-df0fd6bf709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f80efa-5af2-4188-af61-df0fd6bf709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa311e-17d0-4318-82f3-cad446724758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Volume a0d8da9e-37d7-4ebb-9eec-5137880ee485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485', 'volume_size': 1} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:18 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f 1073741824" returned: 0 in 0.428s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:18 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f Nov 03 12:26:18 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:18 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.595s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d121978-fc26-4fe7-a0ec-9ea4888fb6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34986218-b9f8-4463-a168-98e1b6e5f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Creating volume bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 from snapshot 5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Volume volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f (8cb64c5f-4fd8-4858-ace5-b292e323fb6f): created successfully Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34986218-b9f8-4463-a168-98e1b6e5f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (73097e1a-a002-48be-8148-7d7f08b73e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] snapshot: 5c3f6877-ae54-4329-aae9-a66f857aea3a, volume: bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:26:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ea40d009-afa2-4dbd-b966-dac46351f729 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd311662-ca86-4bf9-adde-67ee7fadc549]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:19 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:19 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:19 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.362s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0bc59e6-4389-4668-9ceb-f32845ec6444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3d866-447d-4587-b841-818991079674]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:19 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:19 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:19 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Path /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:19 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 Nov 03 12:26:19 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:24 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:24 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:24 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.376s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:26:25 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" returned: 0 in 6.141s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:25 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Image conversion details: src /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:26:25 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Converted 1024.00 MB image at 166.72 MB/s Nov 03 12:26:25 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 is being set with open permissions: ugo+rw Nov 03 12:26:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:26 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 Nov 03 12:26:26 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:26 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" released by "_copy_volume_from_snapshot" :: held 7.195s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" released by "_create_volume_from_snapshot" :: held 7.272s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.303s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.809s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398159116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d8da9e-37d7-4ebb-9eec-5137880ee485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:18Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Creating volume a0d8da9e-37d7-4ebb-9eec-5137880ee485 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:26 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 1073741824 Nov 03 12:26:26 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4595707-3c94-41fa-aa1b-67351fbfc482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491', 'volume_size': 1, 'snapshot_id': '5c3f6877-ae54-4329-aae9-a66f857aea3a'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7722c26-b553-4eae-a069-3cc4ce482242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Volume volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 (bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491): created successfully Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7722c26-b553-4eae-a069-3cc4ce482242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Flow 'volume_create_manager' (baa00853-814b-42e5-ba44-3737058a4a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3c09edcb-9c3a-44c6-ad28-97e2e174c83c tempest-SnapshotDependencyTests-883570388 None] Created volume successfully. Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-5c3f6877-ae54-4329-aae9-a66f857aea3a-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-5c3f6877-ae54-4329-aae9-a66f857aea3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:26 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 1073741824" returned: 0 in 0.465s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Deleting offline snapshot 5c3f6877-ae54-4329-aae9-a66f857aea3a of volume b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] snapshot_file for this snap is: volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac64d13-8b63-4f6c-a823-c9c571962eda]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:26 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 Nov 03 12:26:26 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:26 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:26 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:27 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.968s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot db0864c7-71d3-4577-b496-08eae9df346b of volume 8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa311e-17d0-4318-82f3-cad446724758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c5fa4-2c4b-4aa9-8864-1ae03256359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d0e5e1-648c-4307-892c-6880520effc0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Volume volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 (a0d8da9e-37d7-4ebb-9eec-5137880ee485): created successfully Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c5fa4-2c4b-4aa9-8864-1ae03256359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (ba4e2072-4d96-412b-99cb-ff0171af217f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-788ed7b7-29aa-42f5-b28d-c83ad8445c90 tempest-ProjectReaderTests-382859683 None] Created volume successfully. Nov 03 12:26:27 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.403s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0bc59e6-4389-4668-9ceb-f32845ec6444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[501bbe08-16e6-40ed-837e-8a6787693676]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:27 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f Nov 03 12:26:27 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:27 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:27 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:27 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" returned: 0 in 0.379s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:27 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b 1G Nov 03 12:26:27 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:27 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.543s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:27 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:27 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:27 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b 1G" returned: 0 in 0.424s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:27 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b Nov 03 12:26:27 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:28 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-a0d8da9e-37d7-4ebb-9eec-5137880ee485-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "cinder-a0d8da9e-37d7-4ebb-9eec-5137880ee485-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:28 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a Nov 03 12:26:28 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-quobyte-a0d8da9e-37d7-4ebb-9eec-5137880ee485" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-a0d8da9e-37d7-4ebb-9eec-5137880ee485" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:28 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:28 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b is being set with open permissions: ugo+rw Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[03832912-7db1-4948-85e6-d765274b7e27]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:28 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b Nov 03 12:26:28 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:28 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 Nov 03 12:26:28 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:28 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444.5c3f6877-ae54-4329-aae9-a66f857aea3a" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-5c3f6877-ae54-4329-aae9-a66f857aea3a" released by "_delete_snapshot" :: held 1.784s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" released by "delete_snapshot" :: held 1.810s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:28 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b" returned: 0 in 0.283s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Created reservations ['095a1a70-e302-4007-8e54-6ba427036f1d', '322b0b6a-9794-4152-bac8-02caed371bca', '4088f728-5f5e-4f23-bf66-bccfee0bf8da', '2a599adc-b8b9-4440-88b8-c1790c120343'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:28 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info Nov 03 12:26:28 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Delete snapshot completed successfully. Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e1eb412-36f1-4349-ae05-14650ff57178 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-5c3f6877-ae54-4329-aae9-a66f857aea3a-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-b0bc59e6-4389-4668-9ceb-f32845ec6444-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:28 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485" returned: 0 in 0.634s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-b0bc59e6-4389-4668-9ceb-f32845ec6444-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:29 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485 Nov 03 12:26:29 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:29 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info" returned: 0 in 0.517s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info is being set with open permissions: ugo+rw Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b650b4fa-e1eb-4639-b9c6-832703143b4c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:29 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info Nov 03 12:26:29 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:29 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:29 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:29 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-a0d8da9e-37d7-4ebb-9eec-5137880ee485" returned: 0 in 0.349s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-a0d8da9e-37d7-4ebb-9eec-5137880ee485" released by "delete_volume" :: held 1.058s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Created reservations ['84023b0d-c397-47b2-b21e-44ca62ea8576', 'd33e39f5-dc7c-4777-b9f7-e9d33d2e9373', '8e650a12-6020-4e53-9bdb-fc403319c4a8', 'b0d67223-58cd-4f85-bef7-e89821f71cd7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:29 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.info" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:29 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:29 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-57091ed6-622c-4116-82dc-1fdbbc84b10a tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:29 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.421s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:29 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444 Nov 03 12:26:29 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:29 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Deleted volume successfully. Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b300d041-0b62-4b1d-b5a5-6814c6ae3f4b tempest-ProjectReaderTests-382859683 None] Lock "cinder-a0d8da9e-37d7-4ebb-9eec-5137880ee485-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:29 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b0bc59e6-4389-4668-9ceb-f32845ec6444" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-b0bc59e6-4389-4668-9ceb-f32845ec6444" released by "delete_volume" :: held 0.789s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Created reservations ['f4e2b6e6-0c07-4bb3-a4a1-3359eba32e16', 'ed9706d3-cfe4-4025-ad6c-5e68fe009ab7', '19b1402e-3c32-4fa3-a703-7d4476e9e2e0', '082282e3-e0f2-4c71-ac01-a378786ac4fa'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:30 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:30 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[242bab05-6d91-4c96-8886-57b4968b535a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:30 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.270s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Deleted volume successfully. Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f3fe71d-0611-4eb0-a010-6068da88e232 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-b0bc59e6-4389-4668-9ceb-f32845ec6444-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:30 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 Nov 03 12:26:30 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:30 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-db0864c7-71d3-4577-b496-08eae9df346b-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-db0864c7-71d3-4577-b496-08eae9df346b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:30 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491 Nov 03 12:26:30 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-db0864c7-71d3-4577-b496-08eae9df346b" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-db0864c7-71d3-4577-b496-08eae9df346b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot db0864c7-71d3-4577-b496-08eae9df346b of volume 8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f223f-98d8-4132-a807-7fdde608c7f1]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:30 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b Nov 03 12:26:30 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:30 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (1fefb728-94e8-4d6d-a7b4-5c39d052f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9dc99-7b65-4375-bc59-c92558d8cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" returned: 0 in 0.309s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9dc99-7b65-4375-bc59-c92558d8cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177658477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25ad88-3605-4e80-b455-12345c4c4a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:31Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ccdffc-1920-4a52-be47-d6b3c5f5ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ccdffc-1920-4a52-be47-d6b3c5f5ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ddd871-683f-4876-b9b1-99447a04ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ddd871-683f-4876-b9b1-99447a04ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d25ad88-3605-4e80-b455-12345c4c4a55', 'volume_name': 'volume-6d25ad88-3605-4e80-b455-12345c4c4a55', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e2a9a3-3309-4523-a836-4e6756123e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e2a9a3-3309-4523-a836-4e6756123e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b342e-09a9-4c3f-a7a3-5f5200289ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Volume 6d25ad88-3605-4e80-b455-12345c4c4a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d25ad88-3605-4e80-b455-12345c4c4a55', 'volume_size': 1} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177658477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25ad88-3605-4e80-b455-12345c4c4a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:31Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Creating volume 6d25ad88-3605-4e80-b455-12345c4c4a55 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-quobyte-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491" released by "delete_volume" :: held 0.833s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:31 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 1073741824 Nov 03 12:26:31 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Created reservations ['04b500f7-7f84-4c97-8376-dbe17c7972db', 'df922af4-b95a-4ecc-8db8-8c56e44c474d', '58ea713d-67c1-47c2-8187-d42978868f61', '736355ae-4e9e-45f6-be98-e0d9a76fd540'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:31 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:31 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:31 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b" returned: 0 in 0.419s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056c3d9-5857-434e-bda4-9c20cf33f908]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:31 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f Nov 03 12:26:31 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:31 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Deleted volume successfully. Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29018fe1-2b1f-4849-889a-4f54d8ff4073 tempest-SnapshotDependencyTests-883570388 None] Lock "cinder-bbdc5b8c-0d57-4149-b87c-e2b2dcbe9491-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:31 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 1073741824" returned: 0 in 0.569s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:31 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 Nov 03 12:26:31 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:31 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" returned: 0 in 0.449s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:31 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b Nov 03 12:26:31 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:31 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55" returned: 0 in 0.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b342e-09a9-4c3f-a7a3-5f5200289ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d25ad88-3605-4e80-b455-12345c4c4a55', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a9582-58f4-4dd1-a99c-f3edc230759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Volume volume-6d25ad88-3605-4e80-b455-12345c4c4a55 (6d25ad88-3605-4e80-b455-12345c4c4a55): created successfully Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a9582-58f4-4dd1-a99c-f3edc230759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (1fefb728-94e8-4d6d-a7b4-5c39d052f714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2e00834b-955e-44b0-bd50-5f387e24d38c tempest-ProjectReaderTests-382859683 None] Created volume successfully. Nov 03 12:26:32 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:32 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b Nov 03 12:26:32 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:32 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f.db0864c7-71d3-4577-b496-08eae9df346b" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-db0864c7-71d3-4577-b496-08eae9df346b" released by "_delete_snapshot" :: held 1.700s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" released by "delete_snapshot" :: held 1.734s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Created reservations ['6134c561-6a1c-4f8e-96d4-82b2952d0144', 'ae4680da-5b95-4d94-a7c4-6cd2498b10bd', '66c38f2b-0f93-498e-aa23-7a14e339aca7', '39df395a-a8c2-4321-8694-ea9248ab4f89'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b829be5f-547b-4a27-bd15-c3958537c6e7 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-db0864c7-71d3-4577-b496-08eae9df346b-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-8cb64c5f-4fd8-4858-ace5-b292e323fb6f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "cinder-8cb64c5f-4fd8-4858-ace5-b292e323fb6f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49064e-9e8e-4834-8b24-aa62b41f4b9f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:33 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f Nov 03 12:26:33 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-6d25ad88-3605-4e80-b455-12345c4c4a55-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "cinder-6d25ad88-3605-4e80-b455-12345c4c4a55-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-quobyte-6d25ad88-3605-4e80-b455-12345c4c4a55" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-6d25ad88-3605-4e80-b455-12345c4c4a55" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b5ea3-652d-4bb8-87f5-a58766fd188b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:33 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 Nov 03 12:26:33 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:33 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" returned: 0 in 0.394s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:33 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f Nov 03 12:26:33 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:33 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" returned: 0 in 0.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:33 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55" returned: 0 in 0.407s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-8cb64c5f-4fd8-4858-ace5-b292e323fb6f" released by "delete_volume" :: held 0.766s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:33 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55 Nov 03 12:26:33 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Created reservations ['1289fe98-ce08-404f-b3e4-e92e67e1a7a3', '89d1c84e-a2ba-4839-89a6-ca5cc3622b8a', '5a827ed8-32a5-4a02-9693-6cbcedc8cfbc', 'b1699951-0cec-43c7-a025-18d1d60eaa92'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:33 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:33 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:33 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-6d25ad88-3605-4e80-b455-12345c4c4a55" returned: 0 in 0.306s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-6d25ad88-3605-4e80-b455-12345c4c4a55" released by "delete_volume" :: held 0.773s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Created reservations ['fb6eb6e3-999f-424c-b287-063698164769', '9f74d499-1b34-4211-a53e-07dd9ec6939e', 'b0006b57-4532-421d-a2f1-b0927110898d', '1437a532-9bc6-43fc-9ea6-c8b62b2006d6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:34 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.287s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58c64a16-1935-48b7-a792-cfcb3604f8af tempest-ProjectMemberTests-1240272241 None] Lock "cinder-8cb64c5f-4fd8-4858-ace5-b292e323fb6f-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:34 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:34 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:34 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Deleted volume successfully. Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1adbb91b-d725-4200-8025-38c743c8611b tempest-ProjectReaderTests-382859683 None] Lock "cinder-6d25ad88-3605-4e80-b455-12345c4c4a55-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7f36ea06-00a0-4139-8851-5634eff43498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5ffa42-c934-436b-ba12-642a3fa51092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5ffa42-c934-436b-ba12-642a3fa51092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789523290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:35Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db35658f-1fcd-49b4-b96f-16510279cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db35658f-1fcd-49b4-b96f-16510279cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63462a96-1f74-40e2-9bbd-be6ffa3a6d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63462a96-1f74-40e2-9bbd-be6ffa3a6d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca', 'volume_name': 'volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc989e5-f76f-4e8c-bd31-92e6427425e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc989e5-f76f-4e8c-bd31-92e6427425e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fee1b7-ac3c-4a98-9c26-6d3bafe689b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Volume b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca', 'volume_size': 1} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789523290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:35Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Creating volume b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:34 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca 1073741824 Nov 03 12:26:34 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (207e2dfc-bed2-4e9d-9e97-e7ee5cf9cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798a4593-364d-4207-bbda-a728255be039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798a4593-364d-4207-bbda-a728255be039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512444036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2237ec56-114f-47f2-bc94-c1588b721dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:35Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f215d9-b6d1-41c4-89ea-82e72a175508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f215d9-b6d1-41c4-89ea-82e72a175508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa977383-4845-480f-af6b-101bb1ad325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa977383-4845-480f-af6b-101bb1ad325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2237ec56-114f-47f2-bc94-c1588b721dbb', 'volume_name': 'volume-2237ec56-114f-47f2-bc94-c1588b721dbb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c8fa55-6a3c-48ac-ad40-ac07f1b93c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c8fa55-6a3c-48ac-ad40-ac07f1b93c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b331390a-df2b-40ff-bb46-5836e42c00c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Volume 2237ec56-114f-47f2-bc94-c1588b721dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2237ec56-114f-47f2-bc94-c1588b721dbb', 'volume_size': 1} Nov 03 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:35 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca 1073741824" returned: 0 in 0.464s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:35 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca Nov 03 12:26:35 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:35 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" returned: 0 in 0.258s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512444036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2237ec56-114f-47f2-bc94-c1588b721dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4205822816bc4019825c78931decf628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:35Z,use_quota=True,user_id='5df1184e40c848cdbcde66b261c3ec71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Creating volume 2237ec56-114f-47f2-bc94-c1588b721dbb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:35 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fee1b7-ac3c-4a98-9c26-6d3bafe689b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:35 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb 1073741824 Nov 03 12:26:35 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e0f4f0-7812-4df1-ab47-0e8a65356944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Volume volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca (b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca): created successfully Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e0f4f0-7812-4df1-ab47-0e8a65356944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7f36ea06-00a0-4139-8851-5634eff43498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-24970dfe-3c76-493d-bb1c-d798c1397d01 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:35 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb 1073741824" returned: 0 in 0.514s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:36 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb Nov 03 12:26:36 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:36 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb" returned: 0 in 0.284s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b331390a-df2b-40ff-bb46-5836e42c00c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2237ec56-114f-47f2-bc94-c1588b721dbb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9855b614-7e52-4e4e-916c-a1a0c952e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Volume volume-2237ec56-114f-47f2-bc94-c1588b721dbb (2237ec56-114f-47f2-bc94-c1588b721dbb): created successfully Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9855b614-7e52-4e4e-916c-a1a0c952e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Flow 'volume_create_manager' (207e2dfc-bed2-4e9d-9e97-e7ee5cf9cba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-41d6792f-84c0-4720-8a2a-a9450350391a tempest-ProjectReaderTests-382859683 None] Created volume successfully. Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot f97a7f2b-0b1e-49bc-a41e-628f95b9af01 of volume b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb68952-f982-452b-8660-d9a4c9d2c668]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:37 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca Nov 03 12:26:37 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-2237ec56-114f-47f2-bc94-c1588b721dbb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "cinder-2237ec56-114f-47f2-bc94-c1588b721dbb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Acquiring lock "cinder-quobyte-2237ec56-114f-47f2-bc94-c1588b721dbb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-2237ec56-114f-47f2-bc94-c1588b721dbb" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d2e2b-3219-445a-84ea-e6365f7bc57f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:37 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb Nov 03 12:26:37 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:37 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" returned: 0 in 0.399s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:37 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 1G Nov 03 12:26:37 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:37 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb" returned: 0 in 0.439s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:37 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb Nov 03 12:26:37 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:37 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 1G" returned: 0 in 0.444s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:37 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 Nov 03 12:26:37 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:37 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2237ec56-114f-47f2-bc94-c1588b721dbb" returned: 0 in 0.269s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "cinder-quobyte-2237ec56-114f-47f2-bc94-c1588b721dbb" released by "delete_volume" :: held 0.761s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Created reservations ['ae54a6ad-c78d-4145-98b2-2b3e8fd38855', 'be44a38a-658b-4219-a291-3aeec7c1eff0', '9991364d-ed25-41bd-b744-76cdd30434e0', '9f8c107d-dc4a-47ad-a5fc-c8420c6e0597'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:38 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:38 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:38 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 is being set with open permissions: ugo+rw Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:38 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 Nov 03 12:26:38 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:38 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.319s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Deleted volume successfully. Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3b8849b6-2c04-449b-86ed-fb01205d72a2 tempest-ProjectReaderTests-382859683 None] Lock "cinder-2237ec56-114f-47f2-bc94-c1588b721dbb-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:38 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01" returned: 0 in 0.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:38 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info Nov 03 12:26:38 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:38 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info" returned: 0 in 0.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info is being set with open permissions: ugo+rw Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:38 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info Nov 03 12:26:38 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:38 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.info" returned: 0 in 0.282s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a83fbead-eda6-4499-bd16-2c8ae7456067 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-f97a7f2b-0b1e-49bc-a41e-628f95b9af01-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f97a7f2b-0b1e-49bc-a41e-628f95b9af01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-f97a7f2b-0b1e-49bc-a41e-628f95b9af01" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f97a7f2b-0b1e-49bc-a41e-628f95b9af01" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot f97a7f2b-0b1e-49bc-a41e-628f95b9af01 of volume b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f2d77-8afd-4a7c-bbe6-877391c282b0]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:40 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 Nov 03 12:26:40 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:40 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01" returned: 0 in 0.424s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab8254-e934-42c1-a31d-1aa0dd706437]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:40 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca Nov 03 12:26:40 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:40 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" returned: 0 in 0.407s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:41 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 Nov 03 12:26:41 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:41 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01" returned: 0 in 0.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:41 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01 Nov 03 12:26:41 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:41 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca.f97a7f2b-0b1e-49bc-a41e-628f95b9af01" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f97a7f2b-0b1e-49bc-a41e-628f95b9af01" released by "_delete_snapshot" :: held 1.570s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" released by "delete_snapshot" :: held 1.596s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Created reservations ['3398c1ab-90ea-4c8f-93a9-bc4192fa5ac0', '674bd6ba-9458-47b7-a9d7-038fab150fdd', '8f595909-7bfb-43dc-ad5e-cd8f672dc844', '129db7cb-c1d4-4b9f-9f1a-c81c0378d471'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30cd6fbe-9718-4459-8c17-831cc34efbf8 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f97a7f2b-0b1e-49bc-a41e-628f95b9af01-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "cinder-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4603fb-52f2-4250-b914-1e405325c01c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:42 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca Nov 03 12:26:42 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:42 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" returned: 0 in 0.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:42 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca Nov 03 12:26:42 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:42 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca" released by "delete_volume" :: held 0.712s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Created reservations ['69b0393d-5c71-4801-b64c-38615cc0a745', '41ab4bb5-150d-4fb1-8df4-8c03ae1ad4c6', 'c219aa1f-7d6a-42e7-bf31-17b7f8d66841', 'eeadc2a9-d736-499f-bcdf-750dd3206cc5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:43 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:43 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:43 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c815237-acc6-4fbf-81e5-3c7329aadfad tempest-ProjectMemberTests-1240272241 None] Lock "cinder-b2f6c817-ee5a-4f9b-b3ef-5b8d704525ca-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (05a6f4d6-51d6-4bf3-9f83-a06529dec67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2896151-a4f6-46d3-b02f-0bc5802401eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2896151-a4f6-46d3-b02f-0bc5802401eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65055675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a46d113-7250-4fa1-a41a-0b91c46496db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:44Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7354aa78-f364-4a91-9fdb-0198a2712473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7354aa78-f364-4a91-9fdb-0198a2712473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fe57b3-7889-474e-84c5-7325ff102d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fe57b3-7889-474e-84c5-7325ff102d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a46d113-7250-4fa1-a41a-0b91c46496db', 'volume_name': 'volume-9a46d113-7250-4fa1-a41a-0b91c46496db', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16152b61-0e29-4b48-af1c-2120fd9ebc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16152b61-0e29-4b48-af1c-2120fd9ebc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6183570b-e76d-43f9-83d8-6fe23cd3a3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Volume 9a46d113-7250-4fa1-a41a-0b91c46496db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a46d113-7250-4fa1-a41a-0b91c46496db', 'volume_size': 1} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65055675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a46d113-7250-4fa1-a41a-0b91c46496db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:44Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Creating volume 9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:43 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db 1073741824 Nov 03 12:26:43 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:44 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db 1073741824" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:44 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db Nov 03 12:26:44 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:44 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6183570b-e76d-43f9-83d8-6fe23cd3a3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a46d113-7250-4fa1-a41a-0b91c46496db', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd802cf1-f068-4810-ae6e-6c704d03fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Volume volume-9a46d113-7250-4fa1-a41a-0b91c46496db (9a46d113-7250-4fa1-a41a-0b91c46496db): created successfully Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd802cf1-f068-4810-ae6e-6c704d03fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (05a6f4d6-51d6-4bf3-9f83-a06529dec67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0b938ff8-9bce-464c-a63a-4d06641a9b21 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot 5d84997b-74f1-4e24-ae19-418d1ad629de of volume 9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669934e-b918-4d82-a70e-d0bbcdfe0e5e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:45 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db Nov 03 12:26:45 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:45 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db" returned: 0 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:45 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de 1G Nov 03 12:26:45 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:45 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de 1G" returned: 0 in 0.389s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a46d113-7250-4fa1-a41a-0b91c46496db -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:45 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a46d113-7250-4fa1-a41a-0b91c46496db -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de Nov 03 12:26:45 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:46 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a46d113-7250-4fa1-a41a-0b91c46496db -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de is being set with open permissions: ugo+rw Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:46 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de Nov 03 12:26:46 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:46 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:46 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info Nov 03 12:26:46 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:46 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info is being set with open permissions: ugo+rw Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:46 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info Nov 03 12:26:46 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:46 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.info" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6d1c93c9-ca44-4158-b965-bbace28efb38 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-5d84997b-74f1-4e24-ae19-418d1ad629de-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-5d84997b-74f1-4e24-ae19-418d1ad629de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-5d84997b-74f1-4e24-ae19-418d1ad629de" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-5d84997b-74f1-4e24-ae19-418d1ad629de" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot 5d84997b-74f1-4e24-ae19-418d1ad629de of volume 9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[259588de-0443-48ae-b9ec-e6a5a6899064]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:47 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de Nov 03 12:26:47 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:47 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de" returned: 0 in 0.369s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a46d113-7250-4fa1-a41a-0b91c46496db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c6b98-679b-45dd-aae5-76f61fc806b8]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:47 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db Nov 03 12:26:47 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:47 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:47 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de Nov 03 12:26:47 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:48 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:48 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de Nov 03 12:26:48 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:48 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db.5d84997b-74f1-4e24-ae19-418d1ad629de" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-5d84997b-74f1-4e24-ae19-418d1ad629de" released by "_delete_snapshot" :: held 1.400s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" released by "delete_snapshot" :: held 1.425s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Created reservations ['5f49873e-d047-4e8a-a261-a7e670f5dec7', 'c869544f-086a-4ae9-be09-16e3356c1767', '9e27d4fb-daa6-4333-8835-f44acc6e9f80', '7cefd2c6-8be1-431d-9ef8-9f282d5a31cc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b944a3e1-29b3-4962-8bab-b949e85a68d5 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-5d84997b-74f1-4e24-ae19-418d1ad629de-delete_snapshot" released by "delete_snapshot" :: held 1.548s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-9a46d113-7250-4fa1-a41a-0b91c46496db-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-9a46d113-7250-4fa1-a41a-0b91c46496db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ce5d7-2c87-405f-ac7a-343c4a1ff886]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:49 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db Nov 03 12:26:49 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:49 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db" returned: 0 in 0.377s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:49 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db Nov 03 12:26:49 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:49 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-9a46d113-7250-4fa1-a41a-0b91c46496db" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-9a46d113-7250-4fa1-a41a-0b91c46496db" released by "delete_volume" :: held 0.701s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Created reservations ['c67fc718-47a9-4ab9-a9bb-c6835ce07719', 'b41666a2-0f23-4732-9d9c-5cd11d1d8445', '841396c1-7302-4236-8398-0d898d4cbfb5', '276e3098-fa01-4124-94aa-47282437fc77'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:50 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:50 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:50 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0cb9122-3f47-497a-ac7e-33d9007dc631 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-9a46d113-7250-4fa1-a41a-0b91c46496db-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (1a7bea48-c273-40b9-a46e-47b754528f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555c529f-2c5e-494b-bd5f-f061057564be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555c529f-2c5e-494b-bd5f-f061057564be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-664462948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032bb4be-110e-4d9b-8a39-c0c85f60e478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:51Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d619316-55ef-4b5c-8405-061db05db5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d619316-55ef-4b5c-8405-061db05db5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0373e219-f74f-4731-aa8f-496a11d0263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0373e219-f74f-4731-aa8f-496a11d0263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032bb4be-110e-4d9b-8a39-c0c85f60e478', 'volume_name': 'volume-032bb4be-110e-4d9b-8a39-c0c85f60e478', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad744d-9a07-4bf9-aa4e-3af82aad3e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad744d-9a07-4bf9-aa4e-3af82aad3e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452bd271-28f3-41b8-93a7-0efb64e2b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Volume 032bb4be-110e-4d9b-8a39-c0c85f60e478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032bb4be-110e-4d9b-8a39-c0c85f60e478', 'volume_size': 1} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-664462948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032bb4be-110e-4d9b-8a39-c0c85f60e478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:51Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Creating volume 032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:50 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 1073741824 Nov 03 12:26:50 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:51 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 1073741824" returned: 0 in 0.411s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:51 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 Nov 03 12:26:51 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:51 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452bd271-28f3-41b8-93a7-0efb64e2b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032bb4be-110e-4d9b-8a39-c0c85f60e478', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7a576-ee1b-4ac0-83f0-babd5d5c2ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Volume volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 (032bb4be-110e-4d9b-8a39-c0c85f60e478): created successfully Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7a576-ee1b-4ac0-83f0-babd5d5c2ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (1a7bea48-c273-40b9-a46e-47b754528f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6ed0fa2-e9e1-439a-bc85-353a3c889e66 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot f58d18ce-2318-48ff-b3fa-3ebc686e09e7 of volume 032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c225b9b2-473b-42d9-81ab-42d667727ffd]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:52 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 Nov 03 12:26:52 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:52 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:52 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 1G Nov 03 12:26:52 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:52 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 1G" returned: 0 in 0.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:52 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 Nov 03 12:26:52 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:53 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7" returned: 0 in 0.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:53 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 is being set with open permissions: ugo+rw Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:53 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 Nov 03 12:26:53 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:53 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:53 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info Nov 03 12:26:53 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:53 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info" returned: 0 in 0.266s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:53 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info is being set with open permissions: ugo+rw Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:53 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info Nov 03 12:26:53 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:53 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.info" returned: 0 in 0.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a5c3f266-e408-431f-b457-7d5f8ee399d2 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-f58d18ce-2318-48ff-b3fa-3ebc686e09e7-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f58d18ce-2318-48ff-b3fa-3ebc686e09e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-f58d18ce-2318-48ff-b3fa-3ebc686e09e7" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f58d18ce-2318-48ff-b3fa-3ebc686e09e7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot f58d18ce-2318-48ff-b3fa-3ebc686e09e7 of volume 032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[47976d78-0c90-49c0-b08c-a958d6ffcfa5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:54 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 Nov 03 12:26:54 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:54 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-032bb4be-110e-4d9b-8a39-c0c85f60e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[37058a75-dc9e-4890-a646-3c2ce3bd6bae]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:54 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 Nov 03 12:26:54 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:54 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:54 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 Nov 03 12:26:54 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:55 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7" returned: 0 in 0.330s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:55 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7 Nov 03 12:26:55 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:55 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478.f58d18ce-2318-48ff-b3fa-3ebc686e09e7" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-f58d18ce-2318-48ff-b3fa-3ebc686e09e7" released by "_delete_snapshot" :: held 1.402s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" released by "delete_snapshot" :: held 1.424s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Created reservations ['3d649cfd-840b-4942-937b-0d97d2d70410', '9a725e5f-eece-4813-9ba3-386182a346c3', '7a3ad4b5-5e5e-4f07-8ea9-a1a1ff4270fd', '87891bbc-9eab-4e18-ac62-c35c51c9dc6e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-82059435-44f5-44f1-bef8-4163b38222d9 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-f58d18ce-2318-48ff-b3fa-3ebc686e09e7-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-032bb4be-110e-4d9b-8a39-c0c85f60e478-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "cinder-032bb4be-110e-4d9b-8a39-c0c85f60e478-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=139,cinder:INSERT=41,cinder:UPDATE=180,cinder:DELETE=13 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=165,cinder:SELECT=128,cinder:INSERT=50,cinder:DELETE=17 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1369c0b7-72c3-44b9-b7a5-d7751b0b19d5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:56 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 Nov 03 12:26:56 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:56 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478" returned: 0 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:56 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478 Nov 03 12:26:56 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:56 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-032bb4be-110e-4d9b-8a39-c0c85f60e478" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-032bb4be-110e-4d9b-8a39-c0c85f60e478" released by "delete_volume" :: held 0.655s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Created reservations ['3bd22c08-00ab-4fc4-b7b9-1df719d48939', '2fb029ac-945a-4a89-b01c-b4b319e40fc6', 'f3ea998d-f9d9-41f2-ad44-8789ca1e5b3b', 'e25e43a3-5702-4714-8552-79b09a7bbc69'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:57 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:26:57 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:57 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:26:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfb0f4fc-db8c-431c-8d07-e1f6cb75e74d tempest-ProjectMemberTests-1240272241 None] Lock "cinder-032bb4be-110e-4d9b-8a39-c0c85f60e478-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (2efef369-d6a3-4507-a42b-572aec066667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195788f0-734c-46ce-b03a-3dad6b8389c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195788f0-734c-46ce-b03a-3dad6b8389c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771004955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:58Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bbc78-8628-4bb0-b8bf-4c5efe8fc1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bbc78-8628-4bb0-b8bf-4c5efe8fc1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc4684-844d-4a0a-b679-ec9157be43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc4684-844d-4a0a-b679-ec9157be43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5', 'volume_name': 'volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f80023-30c7-475d-9a2f-33ba7371291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f80023-30c7-475d-9a2f-33ba7371291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be41a3a8-bc28-47dc-9208-475f57abd5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Volume e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5', 'volume_size': 1} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771004955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:26:58Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Creating volume e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:26:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:26:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:57 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 1073741824 Nov 03 12:26:57 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:58 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 1073741824" returned: 0 in 0.415s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:58 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 Nov 03 12:26:58 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:58 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be41a3a8-bc28-47dc-9208-475f57abd5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19111e6b-468e-47c2-b15c-93534530e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:26:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Volume volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 (e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5): created successfully Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19111e6b-468e-47c2-b15c-93534530e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (2efef369-d6a3-4507-a42b-572aec066667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:26:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0f0269cc-103a-4187-ab8f-f793aa40a00e tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot 1d1191f0-3c61-431f-881e-bf2ef2068fe5 of volume e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[44600fd7-977d-4455-9cdf-703e915dd240]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:59 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 Nov 03 12:26:59 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:59 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" returned: 0 in 0.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:59 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 1G Nov 03 12:26:59 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:26:59 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 1G" returned: 0 in 0.401s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:26:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:26:59 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 Nov 03 12:26:59 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:00 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5" returned: 0 in 0.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:00 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 is being set with open permissions: ugo+rw Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:00 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 Nov 03 12:27:00 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:00 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:00 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info Nov 03 12:27:00 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:00 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:00 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info is being set with open permissions: ugo+rw Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:00 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info Nov 03 12:27:00 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:00 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.info" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c031a00-2a56-4c17-acd6-2b7f672c9d43 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-1d1191f0-3c61-431f-881e-bf2ef2068fe5-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-1d1191f0-3c61-431f-881e-bf2ef2068fe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-1d1191f0-3c61-431f-881e-bf2ef2068fe5" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-1d1191f0-3c61-431f-881e-bf2ef2068fe5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot 1d1191f0-3c61-431f-881e-bf2ef2068fe5 of volume e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95ad58-65ce-4107-90a9-27c82b960987]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:01 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 Nov 03 12:27:01 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:01 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5" returned: 0 in 0.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc60fb-f4c5-4a7b-b7c4-48b58fa6f87e]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:01 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 Nov 03 12:27:01 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:01 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:02 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 Nov 03 12:27:02 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:02 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:02 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5 Nov 03 12:27:02 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:02 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5.1d1191f0-3c61-431f-881e-bf2ef2068fe5" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-1d1191f0-3c61-431f-881e-bf2ef2068fe5" released by "_delete_snapshot" :: held 1.398s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" released by "delete_snapshot" :: held 1.419s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Created reservations ['3a57fe11-b4c1-43ce-a6f4-15233338c063', '2b2e0618-e831-40ef-841a-0eb4b2afb6b7', 'e1ef4513-a43f-49d3-9d1f-2f502d52792f', '4bdbe85c-31fd-430b-9f03-e81c92430e93'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-61f6d43b-2b2c-4282-8bc9-66340e11b0d1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-1d1191f0-3c61-431f-881e-bf2ef2068fe5-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b052a6-fe85-4880-a9db-4ec89d2d02a2]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:03 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 Nov 03 12:27:03 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:03 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:03 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5 Nov 03 12:27:03 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:04 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" returned: 0 in 0.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5" released by "delete_volume" :: held 0.679s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Created reservations ['ea2c9f8c-08f9-48f5-8710-3cd9aa39ecc1', '7725b902-f819-4311-9d72-a3bdde36a6b0', 'c8e29d3a-f0bb-45c8-8d7f-739d2db3021a', '8c997175-5394-4b85-8593-0a6d55e1fd2f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:04 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:04 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:04 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eacb497d-8dea-4b9f-8b48-6bb226547f6b tempest-ProjectMemberTests-1240272241 None] Lock "cinder-e85ecc8c-c1d6-4bf3-afaf-f19d878bddb5-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7c70eeee-a9b8-48fa-a79f-ef2e51ab477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d615ae6-8040-4229-9d73-3bc56ca57425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d615ae6-8040-4229-9d73-3bc56ca57425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857348456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a532372-b2d4-400e-a8a2-58c4979e9d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:05Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b37153-51a8-429b-96a4-78de15b5432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b37153-51a8-429b-96a4-78de15b5432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3756ade6-0bf5-4e5c-9bd0-b3cbe5ae5c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3756ade6-0bf5-4e5c-9bd0-b3cbe5ae5c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a532372-b2d4-400e-a8a2-58c4979e9d53', 'volume_name': 'volume-2a532372-b2d4-400e-a8a2-58c4979e9d53', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3ecd10-0c97-4a55-8cfd-b8a875eea375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3ecd10-0c97-4a55-8cfd-b8a875eea375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a4ee18-7721-49cd-8ac8-8d1ecc9504da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Volume 2a532372-b2d4-400e-a8a2-58c4979e9d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a532372-b2d4-400e-a8a2-58c4979e9d53', 'volume_size': 1} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857348456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a532372-b2d4-400e-a8a2-58c4979e9d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:05Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Creating volume 2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:05 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 1073741824 Nov 03 12:27:05 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:05 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 1073741824" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:05 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 Nov 03 12:27:05 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:05 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53" returned: 0 in 0.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a4ee18-7721-49cd-8ac8-8d1ecc9504da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a532372-b2d4-400e-a8a2-58c4979e9d53', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aea6c1e-41a2-41ad-b9d0-1bc97b3d939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Volume volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 (2a532372-b2d4-400e-a8a2-58c4979e9d53): created successfully Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aea6c1e-41a2-41ad-b9d0-1bc97b3d939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (7c70eeee-a9b8-48fa-a79f-ef2e51ab477e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f57545e-dbe5-4446-8ae5-1cf363fede44 tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot cd4619d0-b626-401c-be27-85f8dd7bca3c of volume 2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca96de-5e5e-4bef-9f82-92b66acc8c6b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:06 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 Nov 03 12:27:06 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:06 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:06 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c 1G Nov 03 12:27:06 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:06 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c 1G" returned: 0 in 0.393s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:06 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c Nov 03 12:27:06 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:07 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c" returned: 0 in 0.288s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:07 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c is being set with open permissions: ugo+rw Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:07 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c Nov 03 12:27:07 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:07 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:07 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info Nov 03 12:27:07 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:07 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:07 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info is being set with open permissions: ugo+rw Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:07 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info Nov 03 12:27:07 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:07 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.info" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-40d38f0a-db11-4574-99ab-8182bbfc7827 tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-cd4619d0-b626-401c-be27-85f8dd7bca3c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-cd4619d0-b626-401c-be27-85f8dd7bca3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-cd4619d0-b626-401c-be27-85f8dd7bca3c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-cd4619d0-b626-401c-be27-85f8dd7bca3c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot cd4619d0-b626-401c-be27-85f8dd7bca3c of volume 2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ad0f2e-48b1-4b21-97ac-ab30e99315d9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:08 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c Nov 03 12:27:08 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:08 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a532372-b2d4-400e-a8a2-58c4979e9d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b988fd-c280-42d3-b5f8-a93987e4669f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:08 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 Nov 03 12:27:08 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:09 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53" returned: 0 in 0.359s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:09 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c Nov 03 12:27:09 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:09 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c" returned: 0 in 0.341s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:09 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c Nov 03 12:27:09 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:09 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53.cd4619d0-b626-401c-be27-85f8dd7bca3c" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-cd4619d0-b626-401c-be27-85f8dd7bca3c" released by "_delete_snapshot" :: held 1.403s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" released by "delete_snapshot" :: held 1.423s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Created reservations ['2b6c4a6e-5e18-4800-ad32-17f22d38cff6', 'a073e60b-7f1e-48aa-833d-97e3c11879e8', '5d0f599d-9017-4c91-9ff7-16646521c543', '4a82042f-cc53-44a4-9b46-b0051a7d3a97'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:27:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70b06a3f-f903-4e3e-95a1-4f3b20c983e1 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-cd4619d0-b626-401c-be27-85f8dd7bca3c-delete_snapshot" released by "delete_snapshot" :: held 1.552s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-2a532372-b2d4-400e-a8a2-58c4979e9d53-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-2a532372-b2d4-400e-a8a2-58c4979e9d53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cdaebc-05da-4646-8204-0781c84f1d7f]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:10 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 Nov 03 12:27:10 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:10 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53" returned: 0 in 0.360s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:10 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53 Nov 03 12:27:10 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:11 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-2a532372-b2d4-400e-a8a2-58c4979e9d53" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-2a532372-b2d4-400e-a8a2-58c4979e9d53" released by "delete_volume" :: held 0.669s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Created reservations ['35d886f2-0f59-4700-b243-2d9870f1b3f7', 'b4f70e8d-fa27-4d24-9181-0c811e8474ae', 'f0c7fe67-7eb2-47ff-a311-b59c9be8d6e2', '8da1fec8-f339-4693-8667-9434436cb571'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:11 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:11 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:11 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4684a4da-c776-44d2-ae1c-4010a1e81fb3 tempest-ProjectMemberTests-1240272241 None] Lock "cinder-2a532372-b2d4-400e-a8a2-58c4979e9d53-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (ea4f9bc4-fd65-4079-9ade-67e5e0fafa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78bb51b-8fe3-42a9-849a-25471916122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78bb51b-8fe3-42a9-849a-25471916122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521743731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04809d66-59b3-4895-a1cd-8692641b1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:12Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81112f0-16c9-4c6e-8910-3f4d1e53de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81112f0-16c9-4c6e-8910-3f4d1e53de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da016cf4-2929-47fe-8b09-3811dcded164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da016cf4-2929-47fe-8b09-3811dcded164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04809d66-59b3-4895-a1cd-8692641b1d76', 'volume_name': 'volume-04809d66-59b3-4895-a1cd-8692641b1d76', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e407b-3c27-492a-ae68-4632ebdea438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e407b-3c27-492a-ae68-4632ebdea438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4474cc9c-43dc-4fd7-84dc-c336dd0c97a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Volume 04809d66-59b3-4895-a1cd-8692641b1d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04809d66-59b3-4895-a1cd-8692641b1d76', 'volume_size': 1} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521743731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04809d66-59b3-4895-a1cd-8692641b1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33eb45b993b741cbb6f304f5d8cf730a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:12Z,use_quota=True,user_id='96c8caf1a27f440b8d15c530727f7937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Creating volume 04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:12 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 1073741824 Nov 03 12:27:12 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:12 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 1073741824" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:12 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 Nov 03 12:27:12 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:12 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76" returned: 0 in 0.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4474cc9c-43dc-4fd7-84dc-c336dd0c97a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04809d66-59b3-4895-a1cd-8692641b1d76', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5792b8-0339-4a25-ba96-0bf0cc13cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Volume volume-04809d66-59b3-4895-a1cd-8692641b1d76 (04809d66-59b3-4895-a1cd-8692641b1d76): created successfully Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5792b8-0339-4a25-ba96-0bf0cc13cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Flow 'volume_create_manager' (ea4f9bc4-fd65-4079-9ade-67e5e0fafa7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ff77b0aa-a8a5-4abf-9d6a-cd8127dbc2cd tempest-ProjectMemberTests-1240272241 None] Created volume successfully. Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Creating offline snapshot 5602d728-1169-4c9a-97b8-43f70dfb2da2 of volume 04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5711ffd-14d0-4994-a848-0908247d4888]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:13 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 Nov 03 12:27:13 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:13 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:13 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 1G Nov 03 12:27:13 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:13 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 1G" returned: 0 in 0.401s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04809d66-59b3-4895-a1cd-8692641b1d76 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:13 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04809d66-59b3-4895-a1cd-8692641b1d76 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 Nov 03 12:27:13 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:14 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04809d66-59b3-4895-a1cd-8692641b1d76 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2" returned: 0 in 0.288s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 is being set with open permissions: ugo+rw Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:14 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 Nov 03 12:27:14 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:14 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:14 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info Nov 03 12:27:14 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:14 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info" returned: 0 in 0.265s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info is being set with open permissions: ugo+rw Nov 03 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:14 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info Nov 03 12:27:14 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:15 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.info" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bece2a18-edaa-4925-8b6d-929aa04ddc5b tempest-ProjectMemberTests-1240272241 None] Create snapshot completed successfully Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-5602d728-1169-4c9a-97b8-43f70dfb2da2-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-5602d728-1169-4c9a-97b8-43f70dfb2da2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-5602d728-1169-4c9a-97b8-43f70dfb2da2" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-5602d728-1169-4c9a-97b8-43f70dfb2da2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Deleting offline snapshot 5602d728-1169-4c9a-97b8-43f70dfb2da2 of volume 04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] snapshot_file for this snap is: volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2217308-f5ed-4339-ade7-c853d00413ed]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:15 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 Nov 03 12:27:15 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:15 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2" returned: 0 in 0.366s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04809d66-59b3-4895-a1cd-8692641b1d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e4b12-7146-4fe2-884e-c074af1f36d9]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:15 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 Nov 03 12:27:15 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:16 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76" returned: 0 in 0.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:16 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 Nov 03 12:27:16 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:16 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2" returned: 0 in 0.352s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:16 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2 Nov 03 12:27:16 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:16 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76.5602d728-1169-4c9a-97b8-43f70dfb2da2" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-5602d728-1169-4c9a-97b8-43f70dfb2da2" released by "_delete_snapshot" :: held 1.456s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" released by "delete_snapshot" :: held 1.481s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Created reservations ['7cb4505a-3ec4-4a8a-8c71-b3652cf48e3e', '9b24c27c-abeb-4dca-969d-c685a0ca37dc', 'b1674620-5048-49f1-9793-dd5280bcbc23', 'd5c1b0dd-a7b6-4b25-82c5-2ca1dddbf23b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Delete snapshot completed successfully. Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-908c8a8a-5172-4d1c-b267-b727375cd75e tempest-ProjectMemberTests-1240272241 None] Lock "cinder-5602d728-1169-4c9a-97b8-43f70dfb2da2-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-04809d66-59b3-4895-a1cd-8692641b1d76-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "cinder-04809d66-59b3-4895-a1cd-8692641b1d76-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Acquiring lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff5f70-3ba4-400e-a3ac-847df502a727]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:17 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 Nov 03 12:27:17 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:18 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:18 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76 Nov 03 12:27:18 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:18 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-04809d66-59b3-4895-a1cd-8692641b1d76" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "cinder-quobyte-04809d66-59b3-4895-a1cd-8692641b1d76" released by "delete_volume" :: held 0.669s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Created reservations ['91f1697e-95e4-4d66-a67b-61427d87b0f7', '708b011e-69b4-4bf4-9943-9f4e76da8fdf', 'b2fd2ac6-2707-4046-9022-f136808f867f', '83eec2e5-01ed-4e26-9131-77ff53bf74db'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:18 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:18 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:18 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Deleted volume successfully. Nov 03 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-72ead596-d9d4-4074-a82c-f64ace2ab3ce tempest-ProjectMemberTests-1240272241 None] Lock "cinder-04809d66-59b3-4895-a1cd-8692641b1d76-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (6e33015d-9fd9-4ade-ad36-c1ba1455e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a83736-ce85-46db-90c1-5c1b1c2dfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a83736-ce85-46db-90c1-5c1b1c2dfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219426337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:22Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aec43b-27b1-404e-844f-e5ad3dc28079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aec43b-27b1-404e-844f-e5ad3dc28079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4387c3bf-cbe9-4b77-b82e-b40b9301dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4387c3bf-cbe9-4b77-b82e-b40b9301dc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6', 'volume_name': 'volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6597fd86-0636-408f-a5e4-07dcc1a89b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6597fd86-0636-408f-a5e4-07dcc1a89b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da89908-a9b9-4f59-b723-e085257a5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Volume 3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6', 'volume_size': 1} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219426337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:22Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Creating volume 3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:22 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 1073741824 Nov 03 12:27:22 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:22 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 1073741824" returned: 0 in 0.406s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:22 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 Nov 03 12:27:22 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:22 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da89908-a9b9-4f59-b723-e085257a5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ea1ca6-0e39-4e41-a472-80b24066ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Volume volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 (3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6): created successfully Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ea1ca6-0e39-4e41-a472-80b24066ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (6e33015d-9fd9-4ade-ad36-c1ba1455e638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f29122bc-803e-472f-b139-071227cebfa2 tempest-ProjectReaderTests-1202500943 None] Created volume successfully. Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Creating offline snapshot 3743cdd4-d152-483f-99f0-a75450a9c917 of volume 3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f319eb-78c5-49e9-be9e-627125341a91]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:23 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 Nov 03 12:27:23 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:23 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" returned: 0 in 0.350s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:23 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 1G Nov 03 12:27:23 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:24 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:24 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:24 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 1G" returned: 0 in 0.414s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:24 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 Nov 03 12:27:24 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:24 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:27:24 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917" returned: 0 in 0.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:24 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 is being set with open permissions: ugo+rw Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:24 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 Nov 03 12:27:24 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:24 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:24 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info Nov 03 12:27:24 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:25 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:25 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info is being set with open permissions: ugo+rw Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:25 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info Nov 03 12:27:25 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:25 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.info" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-38ce74e9-fefb-4406-b4f8-78f09bb0d8c0 tempest-ProjectReaderTests-1202500943 None] Create snapshot completed successfully Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-3743cdd4-d152-483f-99f0-a75450a9c917-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3743cdd4-d152-483f-99f0-a75450a9c917-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3743cdd4-d152-483f-99f0-a75450a9c917" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3743cdd4-d152-483f-99f0-a75450a9c917" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Deleting offline snapshot 3743cdd4-d152-483f-99f0-a75450a9c917 of volume 3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] snapshot_file for this snap is: volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148665e-0691-4d5b-85b9-5c65715ada81]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:25 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 Nov 03 12:27:25 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:26 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917" returned: 0 in 0.364s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efa3f2e-aed1-47d6-bd38-7c608529edc5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:26 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 Nov 03 12:27:26 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:26 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" returned: 0 in 0.374s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:26 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 Nov 03 12:27:26 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:26 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917" returned: 0 in 0.324s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:26 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917 Nov 03 12:27:26 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:27 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6.3743cdd4-d152-483f-99f0-a75450a9c917" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3743cdd4-d152-483f-99f0-a75450a9c917" released by "_delete_snapshot" :: held 1.389s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" released by "delete_snapshot" :: held 1.409s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Created reservations ['745088d8-edd9-496c-9959-df39b4d31330', '0410e97b-2e0f-409a-9bc6-817ec2ae5c6d', 'f52019dd-0853-43f6-b67c-b88a025bf130', 'ff659adc-0ff2-42af-84d1-7aa1f262808d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Delete snapshot completed successfully. Nov 03 12:27:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6515c939-b7b8-4ad7-8d3f-8df1389eba71 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3743cdd4-d152-483f-99f0-a75450a9c917-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed57fb-94b2-46b9-9197-01b207627cd5]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:28 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 Nov 03 12:27:28 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:28 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:28 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6 Nov 03 12:27:28 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:28 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6" released by "delete_volume" :: held 0.663s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Created reservations ['c25fc92b-db63-4ff8-a0b5-7f1b7383f9b0', 'c2ac9def-b3ef-4ba9-8a17-539b6c520bdf', '7601c8f5-0c16-409e-a426-3e18aae6f749', '38fbbee5-ca0c-4184-9afe-0194220de31e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:28 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:28 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:29 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Deleted volume successfully. Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7b3acef6-caf8-4a40-ac63-da61631052c3 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3d7afdd7-3dac-47b5-b5b3-0493f05d5cb6-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (162f12b4-d370-41d9-a695-a44ef9aafbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697eb96a-7c21-461c-9d76-cc82107489fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697eb96a-7c21-461c-9d76-cc82107489fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840946504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff17f58-b6c4-47d7-8593-8a6b9e9350f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:30Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8fbd43-2ad5-426c-a148-87b7af56114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8fbd43-2ad5-426c-a148-87b7af56114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe66534e-1dc5-4e6d-85e8-949d6b236cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe66534e-1dc5-4e6d-85e8-949d6b236cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff17f58-b6c4-47d7-8593-8a6b9e9350f4', 'volume_name': 'volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb003b1-f44a-4f26-b4d6-6bc75ad7719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb003b1-f44a-4f26-b4d6-6bc75ad7719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4d4abe-4284-4dd0-a171-55ff1d872903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Volume 5ff17f58-b6c4-47d7-8593-8a6b9e9350f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4', 'volume_size': 1} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840946504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff17f58-b6c4-47d7-8593-8a6b9e9350f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:30Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Creating volume 5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:29 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 1073741824 Nov 03 12:27:29 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:30 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 1073741824" returned: 0 in 0.413s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:30 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 Nov 03 12:27:30 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:30 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" returned: 0 in 0.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4d4abe-4284-4dd0-a171-55ff1d872903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626572b9-20af-4f58-a581-c31ac9655d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Volume volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 (5ff17f58-b6c4-47d7-8593-8a6b9e9350f4): created successfully Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626572b9-20af-4f58-a581-c31ac9655d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (162f12b4-d370-41d9-a695-a44ef9aafbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2759df78-188c-4f66-8a72-1ef6a1f09500 tempest-ProjectReaderTests-1202500943 None] Created volume successfully. Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Creating offline snapshot 3d5021d9-07d9-4f96-b1fa-b07bed3f173f of volume 5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2189a8-7cea-425f-bf6b-1c8a99bbb29b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:30 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 Nov 03 12:27:30 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:31 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:31 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f 1G Nov 03 12:27:31 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:31 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f 1G" returned: 0 in 0.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:31 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f Nov 03 12:27:31 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:31 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f" returned: 0 in 0.289s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:31 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f is being set with open permissions: ugo+rw Nov 03 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:31 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f Nov 03 12:27:31 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:32 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f" returned: 0 in 0.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:32 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info Nov 03 12:27:32 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:32 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:32 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info is being set with open permissions: ugo+rw Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:32 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info Nov 03 12:27:32 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:32 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.info" returned: 0 in 0.236s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-569ae85e-51dd-4419-ab61-ad9d5740f39c tempest-ProjectReaderTests-1202500943 None] Create snapshot completed successfully Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-3d5021d9-07d9-4f96-b1fa-b07bed3f173f-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3d5021d9-07d9-4f96-b1fa-b07bed3f173f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3d5021d9-07d9-4f96-b1fa-b07bed3f173f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d5021d9-07d9-4f96-b1fa-b07bed3f173f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Deleting offline snapshot 3d5021d9-07d9-4f96-b1fa-b07bed3f173f of volume 5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] snapshot_file for this snap is: volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b060f2-7e9a-4d42-8219-f0764346b58c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:33 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f Nov 03 12:27:33 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:33 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef6b5d-ceda-4bc7-8c88-89ae0af35185]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:33 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 Nov 03 12:27:33 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:33 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" returned: 0 in 0.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:33 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f Nov 03 12:27:33 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:34 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f" returned: 0 in 0.327s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:34 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f Nov 03 12:27:34 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:34 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4.3d5021d9-07d9-4f96-b1fa-b07bed3f173f" returned: 0 in 0.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3d5021d9-07d9-4f96-b1fa-b07bed3f173f" released by "_delete_snapshot" :: held 1.389s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" released by "delete_snapshot" :: held 1.411s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Created reservations ['23a7ad0d-b348-4acc-a31c-5098ab8af516', '2d7be8a4-d0a2-4320-bac9-c2c44b52f340', 'f57ca485-244b-45ba-a547-357a250a1c7b', 'df2c7a83-5b3c-450c-a40b-491c4b1d6283'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Delete snapshot completed successfully. Nov 03 12:27:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ffdd5c-6c49-40a9-84c6-8d7065c6929b tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3d5021d9-07d9-4f96-b1fa-b07bed3f173f-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8940b61-031d-4089-8345-330fa64b146a]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:35 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 Nov 03 12:27:35 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:35 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" returned: 0 in 0.370s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:35 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4 Nov 03 12:27:35 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:35 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4" released by "delete_volume" :: held 0.671s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Created reservations ['3dea5a6d-6b8d-41f4-bf16-ec9833a691b1', '5145488f-3e8f-4737-b91c-6deec42e3d23', 'e3fa7150-af84-488f-bdb5-92fec3e81287', 'd4fb5507-1fb5-4a81-bf82-e7c92fdd9ec9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:35 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:35 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:36 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Deleted volume successfully. Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-84b095ea-cac8-40e8-b6a7-929e03558102 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-5ff17f58-b6c4-47d7-8593-8a6b9e9350f4-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (ab8fe224-12e5-433b-964d-2269c0bdbc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5830541c-df99-4875-a621-842be4fdee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5830541c-df99-4875-a621-842be4fdee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818700278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ca55b-759c-4258-9d8d-49470617d3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:37Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9aa10a-4653-452a-92bd-902e1cb786cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9aa10a-4653-452a-92bd-902e1cb786cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216cce41-dc06-4a96-b9b1-5f9926d58375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216cce41-dc06-4a96-b9b1-5f9926d58375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89ca55b-759c-4258-9d8d-49470617d3e1', 'volume_name': 'volume-b89ca55b-759c-4258-9d8d-49470617d3e1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07314640-7717-41fa-9466-3f14678d84db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07314640-7717-41fa-9466-3f14678d84db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc17408-fd5a-40ee-93e1-71a3c4b1d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Volume b89ca55b-759c-4258-9d8d-49470617d3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89ca55b-759c-4258-9d8d-49470617d3e1', 'volume_size': 1} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818700278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ca55b-759c-4258-9d8d-49470617d3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:37Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Creating volume b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:36 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:36 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 1073741824 Nov 03 12:27:36 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:37 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 1073741824" returned: 0 in 0.412s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:37 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 Nov 03 12:27:37 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:37 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc17408-fd5a-40ee-93e1-71a3c4b1d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89ca55b-759c-4258-9d8d-49470617d3e1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e1958f-8c61-4f8e-ba25-77a3ed237727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Volume volume-b89ca55b-759c-4258-9d8d-49470617d3e1 (b89ca55b-759c-4258-9d8d-49470617d3e1): created successfully Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e1958f-8c61-4f8e-ba25-77a3ed237727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (ab8fe224-12e5-433b-964d-2269c0bdbc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d3c8078a-c10e-4493-9cf0-a0131c3d186c tempest-ProjectReaderTests-1202500943 None] Created volume successfully. Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Creating offline snapshot a2775f8a-1f84-4deb-a7f9-b25754cf28ae of volume b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e851e7a2-aa68-4081-8b57-e0884dbac3c7]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:37 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 Nov 03 12:27:37 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:38 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1" returned: 0 in 0.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:38 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae 1G Nov 03 12:27:38 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:38 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae 1G" returned: 0 in 0.385s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ca55b-759c-4258-9d8d-49470617d3e1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:38 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ca55b-759c-4258-9d8d-49470617d3e1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae Nov 03 12:27:38 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:38 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ca55b-759c-4258-9d8d-49470617d3e1 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae" returned: 0 in 0.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae is being set with open permissions: ugo+rw Nov 03 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:38 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae Nov 03 12:27:38 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:39 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:39 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info Nov 03 12:27:39 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:39 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:39 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info is being set with open permissions: ugo+rw Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:39 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info Nov 03 12:27:39 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:39 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.info" returned: 0 in 0.239s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-799ef5fe-0568-4bda-95f4-ecd03e5d5d9f tempest-ProjectReaderTests-1202500943 None] Create snapshot completed successfully Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-a2775f8a-1f84-4deb-a7f9-b25754cf28ae-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-a2775f8a-1f84-4deb-a7f9-b25754cf28ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-a2775f8a-1f84-4deb-a7f9-b25754cf28ae" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-a2775f8a-1f84-4deb-a7f9-b25754cf28ae" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Deleting offline snapshot a2775f8a-1f84-4deb-a7f9-b25754cf28ae of volume b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] snapshot_file for this snap is: volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd80d5-d848-4ab2-a2c8-df762ecbcf2c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:40 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae Nov 03 12:27:40 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:40 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae" returned: 0 in 0.359s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b89ca55b-759c-4258-9d8d-49470617d3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48593d7-483f-4a9e-9209-613c04fea249]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:40 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 Nov 03 12:27:40 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:40 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1" returned: 0 in 0.345s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:40 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae Nov 03 12:27:40 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:41 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae" returned: 0 in 0.332s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:41 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae Nov 03 12:27:41 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:41 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1.a2775f8a-1f84-4deb-a7f9-b25754cf28ae" returned: 0 in 0.255s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-a2775f8a-1f84-4deb-a7f9-b25754cf28ae" released by "_delete_snapshot" :: held 1.387s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" released by "delete_snapshot" :: held 1.411s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Created reservations ['5b7cba54-2518-4177-9e2f-22c27ae56282', '09df8fa0-bbec-4cf0-9529-1188af5dbd2a', '95bcb4c3-5f3b-428b-b0b3-67ad1b552cc2', '10e34094-a5a0-4c4b-98e9-eda4bc5cd31a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Delete snapshot completed successfully. Nov 03 12:27:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99c0ff4c-f0b1-478f-bd3b-7480cb870d20 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-a2775f8a-1f84-4deb-a7f9-b25754cf28ae-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-b89ca55b-759c-4258-9d8d-49470617d3e1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "cinder-b89ca55b-759c-4258-9d8d-49470617d3e1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6231f4-95b3-41cf-8ec5-173e871bcb5c]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:42 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 Nov 03 12:27:42 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:42 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1" returned: 0 in 0.359s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:42 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1 Nov 03 12:27:42 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:42 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-b89ca55b-759c-4258-9d8d-49470617d3e1" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-b89ca55b-759c-4258-9d8d-49470617d3e1" released by "delete_volume" :: held 0.674s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Created reservations ['08802419-d65e-4615-9e39-7b85e975d704', '0190a86a-d142-4486-9638-9eadb1149b54', 'e1d96502-e699-4b84-bd0b-f2984980a5ac', '1f73e341-14de-4ea2-a3fa-52eaffa3e1b1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:42 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:42 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:43 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.253s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Deleted volume successfully. Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-771d13c2-f10a-4ec2-9203-481fbb42804c tempest-ProjectReaderTests-1202500943 None] Lock "cinder-b89ca55b-759c-4258-9d8d-49470617d3e1-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (8e4f4756-63d6-420c-8982-1c17b53d3fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733ac35f-6aae-4ed2-81dd-a0af17596db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733ac35f-6aae-4ed2-81dd-a0af17596db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808789468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172e3f2-a784-42d0-aa11-1bf94ffbef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:44Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a876a97d-da6c-47fb-b412-818d3b00b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a876a97d-da6c-47fb-b412-818d3b00b40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43ab537-c432-4364-ac70-e7a35d6ebd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43ab537-c432-4364-ac70-e7a35d6ebd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3172e3f2-a784-42d0-aa11-1bf94ffbef5c', 'volume_name': 'volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc46230-2116-48da-abd1-0e8048494ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc46230-2116-48da-abd1-0e8048494ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4de8817-9a4e-4343-ab17-5f9ef6206e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Volume 3172e3f2-a784-42d0-aa11-1bf94ffbef5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c', 'volume_size': 1} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808789468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172e3f2-a784-42d0-aa11-1bf94ffbef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:44Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Creating volume 3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:43 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:43 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c 1073741824 Nov 03 12:27:43 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:44 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c 1073741824" returned: 0 in 0.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:44 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c Nov 03 12:27:44 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:44 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" returned: 0 in 0.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4de8817-9a4e-4343-ab17-5f9ef6206e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c075a3a-5935-4642-874d-ce91dd07d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Volume volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c (3172e3f2-a784-42d0-aa11-1bf94ffbef5c): created successfully Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c075a3a-5935-4642-874d-ce91dd07d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (8e4f4756-63d6-420c-8982-1c17b53d3fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-df3c0ad9-d9a8-4d4c-a710-e703b068ab48 tempest-ProjectReaderTests-1202500943 None] Created volume successfully. Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Creating offline snapshot 70c6b22a-3170-4a62-96a0-afc9a0263080 of volume 3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c22329-4009-4447-a3d1-73715908b969]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:44 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c Nov 03 12:27:44 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:45 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" returned: 0 in 0.364s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:45 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 1G Nov 03 12:27:45 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:45 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 1G" returned: 0 in 0.410s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:45 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 Nov 03 12:27:45 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:45 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080" returned: 0 in 0.289s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:45 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 is being set with open permissions: ugo+rw Nov 03 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:45 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 Nov 03 12:27:45 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:46 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080" returned: 0 in 0.249s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:46 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info Nov 03 12:27:46 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:46 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info" returned: 0 in 0.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info is being set with open permissions: ugo+rw Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:46 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info Nov 03 12:27:46 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:46 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.info" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8fed18cb-5061-4f25-9c11-e047b138b766 tempest-ProjectReaderTests-1202500943 None] Create snapshot completed successfully Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-70c6b22a-3170-4a62-96a0-afc9a0263080-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-70c6b22a-3170-4a62-96a0-afc9a0263080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-70c6b22a-3170-4a62-96a0-afc9a0263080" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-70c6b22a-3170-4a62-96a0-afc9a0263080" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Deleting offline snapshot 70c6b22a-3170-4a62-96a0-afc9a0263080 of volume 3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] snapshot_file for this snap is: volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b66e23-dfd3-47dd-bdd6-4ae824649a84]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:47 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 Nov 03 12:27:47 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:47 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e380de84-c3aa-4d03-a825-7ec722338934]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:47 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c Nov 03 12:27:47 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:47 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" returned: 0 in 0.348s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:47 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 Nov 03 12:27:47 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:48 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:48 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080 Nov 03 12:27:48 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:48 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c.70c6b22a-3170-4a62-96a0-afc9a0263080" returned: 0 in 0.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-70c6b22a-3170-4a62-96a0-afc9a0263080" released by "_delete_snapshot" :: held 1.365s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" released by "delete_snapshot" :: held 1.385s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Created reservations ['e8702dfe-ad87-4f19-ad15-26cbd926daa8', 'dd78bc2c-1826-4bf7-93a9-3b989b4f8a7a', '66253842-e585-4638-9619-7b72b8320bcb', '6f53db5c-0b26-4003-a684-73d2e22e17eb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Delete snapshot completed successfully. Nov 03 12:27:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-321b233d-9d8c-49e4-a88d-a7e7f8e70ae0 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-70c6b22a-3170-4a62-96a0-afc9a0263080-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-3172e3f2-a784-42d0-aa11-1bf94ffbef5c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3172e3f2-a784-42d0-aa11-1bf94ffbef5c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f93ee1-3d00-489f-9566-bcd5c792354b]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:49 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c Nov 03 12:27:49 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:49 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:49 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c Nov 03 12:27:49 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:49 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" returned: 0 in 0.264s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-3172e3f2-a784-42d0-aa11-1bf94ffbef5c" released by "delete_volume" :: held 0.682s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Created reservations ['5c202cee-0dab-431a-a9c1-e2b6df2e8bd6', '7e910f48-e3ec-424d-9b2d-6e24eb89efdc', '83953e0d-055f-4c4c-8b5d-9151561650bd', '5483c888-23a7-4c46-ae50-b352519026e8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:49 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:49 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:50 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.277s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Deleted volume successfully. Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56c50d3c-98cf-4446-9b5b-86f7485300e6 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-3172e3f2-a784-42d0-aa11-1bf94ffbef5c-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (c49a6a60-6185-4332-bd07-54bb25f8ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105fc51d-31b0-487b-a127-fc7a19dd4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105fc51d-31b0-487b-a127-fc7a19dd4b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-100507917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb14ea5-c7ef-4e73-bd82-930091e8e7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:51Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559f9a98-bd74-4c0f-9219-9485dc5536c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559f9a98-bd74-4c0f-9219-9485dc5536c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c949ef6-377c-4a07-bde8-a7251e9101ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c949ef6-377c-4a07-bde8-a7251e9101ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb14ea5-c7ef-4e73-bd82-930091e8e7f4', 'volume_name': 'volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d056eefa-1fc7-469b-bc09-72df0167a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d056eefa-1fc7-469b-bc09-72df0167a28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a65d68f-dcca-40a3-b33b-74be9514c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Volume 7cb14ea5-c7ef-4e73-bd82-930091e8e7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4', 'volume_size': 1} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-100507917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb14ea5-c7ef-4e73-bd82-930091e8e7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bce8afc66545e0b9c4ab79c5fd5fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:27:51Z,use_quota=True,user_id='611f4097ecb142c2ba6435c2fd888560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e260cc-b232-4a8f-8ad5-60bac729fcf0),volume_type_id=d3e260cc-b232-4a8f-8ad5-60bac729fcf0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Creating volume 7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Selected osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:27:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] casted to osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297 Nov 03 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:50 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 1073741824 Nov 03 12:27:50 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:51 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 1073741824" returned: 0 in 0.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:51 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 Nov 03 12:27:51 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:51 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" returned: 0 in 0.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a65d68f-dcca-40a3-b33b-74be9514c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc39f249-3f94-4356-9a49-55b4a01470b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:27:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Volume volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 (7cb14ea5-c7ef-4e73-bd82-930091e8e7f4): created successfully Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc39f249-3f94-4356-9a49-55b4a01470b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Flow 'volume_create_manager' (c49a6a60-6185-4332-bd07-54bb25f8ee86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:27:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2c14b508-2aaa-499f-92d8-30dc37e6133b tempest-ProjectReaderTests-1202500943 None] Created volume successfully. Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Creating offline snapshot 95edec9f-584f-4fe8-841e-5e7fe8d9fedb of volume 7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f96ef-cc51-4dfb-b6ef-bbc17ddcfa30]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:52 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 Nov 03 12:27:52 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:52 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" returned: 0 in 0.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:52 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb 1G Nov 03 12:27:52 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:52 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb 1G" returned: 0 in 0.384s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:52 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb Nov 03 12:27:52 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:52 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 -F qcow2 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb" returned: 0 in 0.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:52 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb is being set with open permissions: ugo+rw Nov 03 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:52 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb Nov 03 12:27:52 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:53 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb" returned: 0 in 0.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:53 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info Nov 03 12:27:53 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:53 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info" returned: 0 in 0.251s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:53 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info is being set with open permissions: ugo+rw Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:53 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info Nov 03 12:27:53 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:53 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.info" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ad35e974-5088-4f8b-b2d8-6cba16a1bb92 tempest-ProjectReaderTests-1202500943 None] Create snapshot completed successfully Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-95edec9f-584f-4fe8-841e-5e7fe8d9fedb-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-95edec9f-584f-4fe8-841e-5e7fe8d9fedb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-95edec9f-584f-4fe8-841e-5e7fe8d9fedb" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-95edec9f-584f-4fe8-841e-5e7fe8d9fedb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Deleting offline snapshot 95edec9f-584f-4fe8-841e-5e7fe8d9fedb of volume 7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] snapshot_file for this snap is: volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db95f8-00df-4ad0-9b2b-b06280b943ed]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:54 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb Nov 03 12:27:54 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:54 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb" returned: 0 in 0.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6e279-4cb7-4bc6-a39b-bd6e97d8a059]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:54 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 Nov 03 12:27:54 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:54 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" returned: 0 in 0.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:54 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb Nov 03 12:27:54 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:55 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb" returned: 0 in 0.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:55 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb Nov 03 12:27:55 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:55 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4.95edec9f-584f-4fe8-841e-5e7fe8d9fedb" returned: 0 in 0.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-95edec9f-584f-4fe8-841e-5e7fe8d9fedb" released by "_delete_snapshot" :: held 1.379s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" released by "delete_snapshot" :: held 1.400s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Created reservations ['1f8ac306-d493-414f-b77e-4959cfaf68df', '52628239-3137-4b0d-b0c6-8914c3414218', '85fff7cc-53af-4fc7-9cc7-fe74ddaac7f0', 'ddfe8f0a-d12f-410e-a67c-a0f7ed91d481'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Delete snapshot completed successfully. Nov 03 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce75030d-ff98-4d21-8ff2-7b254de2f2a1 tempest-ProjectReaderTests-1202500943 None] Lock "cinder-95edec9f-584f-4fe8-841e-5e7fe8d9fedb-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "cinder-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Acquiring lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8855d8a-a05a-43f5-9141-87a1240eb9f6]: (4, 'qcow2') {{(pid=87644) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:56 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 Nov 03 12:27:56 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:56 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" returned: 0 in 0.357s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:56 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4 Nov 03 12:27:56 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:56 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9/volume-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "cinder-quobyte-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4" released by "delete_volume" :: held 0.659s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=120,cinder:INSERT=43,cinder:UPDATE=146,cinder:DELETE=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=143,cinder:DELETE=16 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Created reservations ['6f588bb5-9eda-42ab-a534-c0b7d2d1349c', 'fe19c286-4b27-4b87-9f4f-fd26d729bbe6', 'dd91d8f5-2e22-4c1b-aa07-dd179c4ab62c', '56c6ce22-d1db-481c-8bc9-b75f72f482f2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:27:57 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:27:57 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:27:57 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 03 12:27:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:27:57 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:27:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Deleted volume successfully. Nov 03 12:27:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f3db8a7-cc48-445f-ad0b-615687eaaaec tempest-ProjectReaderTests-1202500943 None] Lock "cinder-7cb14ea5-c7ef-4e73-bd82-930091e8e7f4-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:28:06 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:28:07 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb4346dd-ea63-45aa-aa1d-e16bbdce1297'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:28:24 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9 Nov 03 12:28:24 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:28:24 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/60bf1b48174dcb7b3766a6724c44bed9" returned: 0 in 0.243s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac6f259d-7600-4e04-b09f-eb62f10ee5bf None None] thread info: [<_MainThread(MainThread, started 123514895945856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}